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uU Editors Tip 
Stop by our booth at DevConnections 
March 22—25 in Orlando. We love to hear 
what's up with our readers. 


See the qunm Microsoft made 
to SSRS 2008 and how these new 
features will affect you. 


—Sheila Molnar, executive editor 


SQL Server 200875 

T-SQL Features 

—Itzik Ben-Gan 

Don’t overlook the small T-SQL features in SQL Server 
2008, such as an enhanced VALUES clause, improved ISO 
week number calculation, and the ability to convert 
character to binary and binary to character values while 
preserving the hexadecimal digits. 


Build the Numbers Table 

You Need 

—Frank Solomon 

Use this custom tool to create a numbers table that works 
around the limitations of traditional techniques for 
building these tables. 


Trace Reporting with 

RML Utilities 

—Andrew J. Kelly 

Are you using SQL Server’s CLR functionality to parse 
trace files? Microsoft recently updated its RML utilities, and 
you might find them easier to use—and a great addition to 
your arsenal. 


What's New for SQL Developers 
in Visual Studio 2008 

—William Vaughn 

Learn about new features in the service pack, such as 
reporting and data caching, that you can use when 
developing applications. 
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You won't want to kill this session! 


SQLServerPedia is a free, interactive online resource that helps you make every 
performance a smash hit. Get your fill of pitch-perfect wiki articles, video tutorials, 
backup and recovery scripts, index maintenance and performance tuning. Mix in 
eight of the top industry experts and you've got what you need to turn it up to 11. 


SQL Server knowledge, available 24/7/365. ..for free? Yeah, that rocks. 
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This free tool's robust logging lets you quickly figure out why an SSIS package 
that had been executing correctly suddenly isn't. 
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SQL Mag online readers. 
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Microsoft's CodePlex Site 


—Michael Otey 
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—Christan Humphries 
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80 Product Review: 
SQL Data Generator 


—Michael К. Campbell 


Editor's Note 


Check out Derek с 
Comingore’s blog post 
"Tomorrow's Microsoft 


BI Platform” (www.sqimag.com, 
InstantDoc ID 101407) for the 


latest information about Microsoft’s 
next-generation business intelligence 
products. 

—Megan Keller, associate editor 


For generating sample and testing data for SQL Server databases, this data 
generator might win you over as quickly as it generates data. 


31 Product Review: 
Miner3D 7.1 


—Michael К. Campbell 


Deriving useful business intelligence from multidimensional data hasn't been 


easy—until now. 


The Smart Guide to Building World-Class Applications 


Senior Vice President, Kim Paulsen 
Technology Media Group kpaulsen@windowsitpro.com 
International Publisher Jeff Lewis 


jlewis@windowsitpro.com 


Editorial 
Editorial and Custom Strategy Director Michele Crockett 


crockett@sqimag.com 


Editor-in-Chief, Web Content Strategist Jeff James 
Technical Director Michael Otey 

motey@sqimag.com 
Executive Editor, IT Group ту Eisenberg 
Executive Editor, SQL Server and Developer Sheila Molnar 


Dave Bernard 
dbernard@windowsitpro.com 
indy Bushong 

Megan Bearly Keller 


Group Editorial Director 


IT Group Managing Editor 
DBA and BI Editor 

Editors 

Barb Alexy, Karen Bemowski, Jason Bovberg, Erin Bradford, Anne 
Grubb, Vicki Hamende, Linda Harty, Derek Maness, Caroline 
Marwitz, Chris Maxcer, Lavon Peters, Gayle Rodcay, Rita-Lyn 
Sanders, Zac Wiggy, Brian Keith Winstead 
Production Editor 

Administrative Assistant 


Brian Reinholz 
Mary Waterloo 


Contributing Editors 


Ісік Ben-Gan |Ben-Gan@SolidQ.com 
Kalen Delaney kalen@insidesqlserver.com 
Brian Lawton brian.kTawton@redtailcreek.com 
Douglas McDowell YMcDowell@Solidd.com 
Brian Moran foran@SolidQ.com 


Michelle A. Poolet 
Kimberly L. Tripp 
William Vaughn 
Richard Waymire 


mapoolet@mountvernondatasystems.com 
~~ TKimberly@sqIskills.com 
billva@betav.com 
rwaymiGmicrosoft.com - 
Art & Production 


Art Director David Kirby 
Production Director Linda Kirchgesler 
Senior Production Manager Kate Brown 


Assistant Production Manager Erik Lodermeier 


Advertising Sales 
Director of Sales 
619-442-4064 
Key Account Directors 
Jeff Carnes 
Chrissy Ferraro 
Richard Resnick 
Jacquelyn Baillie 
Jeff Lewis 
Account Executives 
Barbara Ritter, West Coast 


Birdie Ghiglione 
birdie.ghiglione@penton.com 


jeff.carnes@penton.com, 678-455-6146 
christina.ferraro@penton.com, 970-203-2883 
“Tichard.resnick@penton.com, 951-302-2998 
jacquelyn.baillie@penton.com, 714-623-5007 
^ Jlewis@windowsitpro.com, 970-613-4960 


barbara.ritter@penton.com, 
858-759-3377 


cassandra.schulz@penton.com, 


Cass Schulz, East Coast 


Ad Production Supervisor Glenda Vaught 
glenda.vaught@penton.com 

Client Project Managers Michelle Andrews 
michelle.andrews@penton.com 

Kim Eck 
kim.eck@penton.com 


Reprints 
Diane Madzelonka 
diane.madzelonka@penton.com 


Reprint Sales 
888-858-8851 
216-931-9268 


Circulation & Marketing 
IT Group Audience Development Director Marie Evans 
Customer Service 800-793-5697 (US and Canada) 
44-161-929-2800 (Europe) 


A lenton 
Penton Media. In. 


Chief Executive Officer Sharon Rowlands 


Sharon.Rowlands@penton.com 

Chief Financial Officer/ Executive Vice President Jean Clifton 
Meanie ШІ аш шай Н 
Copyright 

Unless otherwise noted, all programming code and articles in this issue are copyright 
2009, Penton Media, Inc., all rights reserved. Programs and articles may not be repro- 
duced or distributed in any form without permission in writing from the publisher. 
Redistribution of these programs and articles, or the distribution of derivative 
works, is expressly prohibited. Every effort has been made to ensure examples in 
this publication are accurate. It is the readers responsibility to ensure procedures and 
techniques used from this publication are accurate and appropriate for the users 
installation. No warranty is implied or expressed. Please back up your files before you 
run а new procedure or program or make significant changes to disk files, and be sure 
to test all procedures and programs before putting them into production. 


List Rentals 
Contact Walter Karl, Inc. at 2 Blue Hill Plaza, 3rd Floor, Pearl River, МУ 10965 ог 


www.walterkarl.com/mailings/pentonLD/index.html. 


AUTOVA 
Deliver missionkit® 


database results 
with the complete 
set of tools from Altova® 


The Altova MissionKit® is an integrated suite of 
database, XML, and UML tools with powerful support 
for working with all major relational databases. 


All MissionKit database tools support all of 
the following: 


e Microsoft? SQL Server® » MySQL? 


* Oracle® * PostgreSQL 
“ІВМ DB29 е Microsoft Access™ 
* Sybase? 


The Altova MissionKit includes multiple tools for working 
with databases: 


DatabaseSpy? — SQL editor, query & database design tool 


MapForce? — graphical data mapping, transformation & 
conversion tool 


XMLSpy? - industry-leading XML editor with database integration 


StyleVision? — visual stylesheet design tool for publishing 
database data 


Download a 30 day free trial! 


Try before you buy with a free, 
fully functional, 30-day trial 
from www.altova.com. 


Cloud Computing: 
SQL Mag Readers Weigh In 


loud computing has been embraced by ven- 

dors everywhere—from Microsoft, with of- 
ferings such as the Azure platform and SQL Data 
Services, to VMware and its Virtual Datacenter OS 
and Cloud vServices. Many industry pundits believe 
that businesses of all sizes will eventually move to 
cloud computing, but more cautious experts say 
that cloud computing is just the latest flash in the 
pan and will never replace on-premises computing. 


Problems with the Cloud 

In “Up in the Air Over Cloud Computing," Decem- 
ber 2008, InstantDoc ID 100580, I admitted skepti- 
cism about cloud computing. I saw the cost-saving 
benefits of the cloud but thought they'd be offset by 
problems with availability, reliability, and security. If 
my experience online today is any indication, I was 
right on the money—1my normally rock-solid Inter- 
net connection has been up and down like a yo-yo. 


Readers from IT Shops Speak Out 
Many of you responded to that editorial. Without 
exception, readers from IT shops were skeptical 
about cloud computing and would either avoid it or 
limit its use. Pete Revell notes that with cloud com- 
puting “You don't have the type of control over the 
servers that you have for on-premises equipment. 
On the shared server, we have to put up with other 
databases’ periodic increased workloads— SQL's 
slow again today.’ And they have to put up with 
ours—' Those XXXXs are running their month- 
end processing again!" 

Vishal Сатай likes the concept behind the cloud 
but has concerns about reliability and user experi- 
ence: “Га like to develop applications, implement 
databases, and serve them in the cloud, but, when I 
place myself in the shoes of a consumer subscribing 
to application/data in the cloud, I become paranoid, 
thinking ‘What if the service goes down? What if 
the Internet is down?’ Then my critical business 
app would be hit. Furthermore, why should I trust 
someone else to handle my data. Is it safe?—Too 
many complications." 

Troy Latterell also has concerns about security: 
“Гуе never believed the Internet was secure or reli- 


SQL Server Magazine * www.sqlmag.com 


able enough even today to allow this. If DNS, IP, 
routing, firewalls, antivirus, spamming, phishing, 
SQL injection, and ALL the other things can be 
taken care of —OK. Maybe then.” 


A Specialized Use 

Michael Dragone sees cloud computing as a way 
to address disaster-recovery scenarios. He says 
"I'm most interested in the cloud when it comes to 
SQL Server in the area of disaster recovery. Now, 
many organizations have an offsite data center or 
co-location space that they populate with old serv- 
ers and equipment ‘just in case.’ This equipment is 
itself a disaster. Those that can afford new, modern 
equipment often feel that they've made a wasteful 
financial investment, like a life insurance policy 
that they hope is never cashed in.” 


AVendor Speaks 

I heard from proponents of cloud computing, but 
not too surprisingly they were vendors promoting 
cloud services. One vendor, Jerry Foster, points out 
that “Doubts over cloud computing’s ability to 
secure data and provide uptime that rival internal 
networks have fallen by the wayside, at least for 
us. Are these valid concerns? Sure. But no more so 
than with on-site software, which often has similar 
problems with connectivity and lack of security. So 
the real issue isn’t the platform, but the ability of 
your software provider to prove they can deliver se- 
curity and uptime, while leveraging the advantages 
of their platform and methodology.” 


Whither the Cloud? 

It’s clear that even vendors with lots of clout, such 
as Microsoft and VMware, have a way to go before 
selling the IT profession on moving to the cloud. 
Although cloud computing may not be IT’s silver 
bullet, it’s not just a flash in the pan either, because 
it attempts to capitalize on today’s killer app—the 
ubiquitous Internet. 

What do you think? Does your IT shop em- 
brace the cloud? Drop me a line at motey@sqlmag 
„com. Га love to hear your side of the story. ЕШ 

InstantDoc ID 101284 


Michael Otey 


(motey@ sqlmag.com) is technical director 
for Windows IT Pro and SQL Server Maga- 
zine and author of Microsoft SQL Server 

2008 New Features (Osborne/McGraw-Hill). 
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SQL Server gurus David Chernicoff, 
Greg A. Larsen, Douglas McDowell, 
i oran, Lavon Peters, and 

n: their field-proven 

est practices. 


Technical Advisors, the new 
learning resource from 

SQL Server Magazine, are 
expert-written, quick-reference 
guides with the key information 
you need on critical IT topics. 


Enhance your storage with SANs and iSC. 


Find out if your environment could 

benefit from SSDs. 

Discover the differences between storage types 
and which is best for your organization. 


Track disk usage with a two-step process and use 
the info to calculate growth rate. 


DOWNLOAD THIS FREE SQL SERVER eBOOK TODAY! 


Sglmag.com Community Dialog 
Readers Talk About SQL Server Backup and Tuning 


Backup Tips 

We've seen some interesting reader comments on recent 
articles about SQL Server backup. On Michael Otey's 
*SOL Server Backup Best Practices," InstantDoc ID 
100039, andrewn2008 responded with his own backup 
best practices. “Doing fulls [full backups] daily limits 
your ability to restore via multi-days.... Do a full once 
a week. Do diffs between that time whatever the busi- 
ness needs decides. You'll see your diff backups are 
much smaller. If you have an error, backup the tranlogs 
and go from there. If you need to restore, you've got a 
lot of choices...." 

Reader dwmolek liked Bill McEvoy's sp Show- 
Backups procedure (see “ТаКе the Drudgery Out of 
Making Sure Your Databases Are Being Backed Up 
Properly,” InstantDoc ID 98570). “I have been setting 
up e-mail notification for each backup job. This one 
stopshop may be very helpful." What about you—what 
backup pet peeves or helpful tips would you like to see 
covered in SQL Server Magazine? Email SQL Mag 
editor Sheila Molnar (smolnar(gsglmag.com) and 
let her know. 


Database Tuning... the 
Conversation Continues 
In her column, *Will Database Tuning Become 
Obsolete?” InstantDoc ID 100181, Kalen Delaney 
asks whether database tuning and query optimization 
will be necessary, given the adoption of solid-state 
disk (SSD) and other technologies that push system 
performance to unheard-of levels. Some readers said 
that tuning will always matter, while others believe 
hardware performance improvements will make tuning 
and query design less important. 

Forinstance, DBAFlash said, *Now all we do is shove 
as much memory in the box as we can and not worry 
about performance tuning our code. Our .Net developers 
don't [even] know what performance tuning is... perhaps 
it will be the same for database developers in a few years." 
And from sqlmaniac: “Yes, with SSD, for 90% of the 
database world run in small to medium size shops with 
small to medium size databases, any performance prob- 
lems will all but disappear." Read the rest of the comments 
оп Kalen’s article, and add your thoughts to the mix. ЕР 

InstantDoc ID 100579 
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See what Front Runners are saying: 

"We succeed by being first to deliver a highly scalable and advanced 
enterprise solution on Microsoft for PLM to global customers. Front 
Runner made our success possible" - Marc Lind, Vice President, Aras 


Don't miss out. Solutions need to be completed by April 3rd, 2009. Sign up today! 


Go deep. Go to www.frdinnovateon.com 


I SQL Server Microsoft 


March 2009 9 


SQL Server Magazine * www.sqlmag.com 


eLearning ser|es 


Hit the Ground Running with 
SQL Server Basics! 


Join SQL MVP Allan Hirt on March 26, 2009 and April 30, 
2009 for 6 fundamental SQL Server lessons tailored to 
pros new to SQL, plus live Q&A sessions—all on your own 
computer! Learn how to plan, deploy, and administer SQL 
Server (includes aspects of SQL Server 2000, SQL Server 
2005, and SQL Server 2008). Whether you're new to 
database administration or expanding your knowledge from 
another RDBMS, this series is your SQL Server solution. 


INSTRUCTOR 


Allan Hirt has been consulting, training, 
developing content, speaking at events, 
and authoring books, whitepapers, and 
articles related to SOL Server for the past 
10 years. Allan is the author of the 
“ж. upcoming book Pro SQL Server 2008 
Failover Clustering (Apress), due to be published in the 
spring of 2009. 


Learn more about the speaker, sessions, 
and how to reserve your seat at: 


Windows! Pro 


DTLoggedExec 
Quickly troubleshoot SSIS package 


execution problems 


А: alternative to the DTExec command-prompt 
utility, DTLoggedExec is used to configure and 
execute SQL Server Integration Services (SSIS) pack- 
ages. DTLoggedExec provides all the package execu- 
tion and configuration features that DTExec does, 
such as connections, properties, variables, and progress 
indicators, but with the addition of robust logging of 
each step that an SSIS package executes. 

DTLoggedExec was written by Davide Mauri, a 
mentor at Solid Quality Mentors who lives in Italy. 
Davide wrote the tool to facilitate troubleshooting and 
logging for high-speed data extraction, transformation, 
and loading (ETL) operations in an easy and ad hoc 
method supported by the native DTExec utility. Let's 
take a look at the logging options DTLoggedExec 
offers. 


Determine Why Packages 
Aren't Executing Properly 
DTLoggedExec is intended to compensate for some of 
the limitations of the native DTExec utility. DTLogged- 
Exec provides a robust and intuitive logging infrastruc- 
ture that can help you quickly understand how and why 
a package that has always run correctly suddenly isn't 
working properly. 

You can start DTLoggedExec from the command 
prompt. Starting the program from the command 
prompt lets you enable or disable logging to a text file. 
DTExec also has this capability, but it's cumbersome 
and requires you to code all packages to support log- 
ging before it's needed. DTLoggedExec does away with 
that requirement. 

DTLoggedExec lets you view all the informa- 
tion that's created while running a package without 
having to use Microsoft Visual Studio's debug mode. 
This capability makes fully logged SSIS processing 


LEARNING PATH 
SQL SERVER MAGAZINE RESOURCES 


See previous Tool Time columns at 


"SQL Server 2008 Extended Events Manager," 
InstantDoc ID 100466 


"SQLScripter," InstantDoc ID 100140 
"mRemote," InstantDoc ID 99804 
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and troubleshooting much easier and supportable on 
production servers in which debug mode might not 
typically be allowed. In addition, you can choose which 
events you want DTLoggedExec to log. 

You can also use DTLoggedExec to profile Data 
Flow tasks within an SSIS package. This feature lets 
you log the number of rows processed by the Data 


Flow task, the number of rows sent as I/O, the start Kevin Kline 
and end times of the Data Flow task, and the number 


of times the Data Flow task has been executed (e.g., 
when it's called in a loop). DTLoggedExec also logs 


Kevin Kline (kevin Kline (0) quest.com) is 


the director of technology for SQL Server 


Solutions at Quest Software and a founding 


all variable values, the values of properties bound to һа} member of the international PASS. 


expressions, and all the properties and related connec- He is the author of SQL in а Nutshell, 3rd 
edition (O'Reilly. 


tion properties of erroneous tasks. DTLoggedExec lets 


you log to its console, a 
text file, or a database 
table by defining your 
own log providers. 


System 

Configuration 
DTLoggedExec was 
developed using both 


AUTHOR’S NOTE 
Give us your feedback on the Tool 
Time discussion forum at sqlforums 


windowsitpro.com/web/forum/categories 


.aspx?catid- 169&entercat-y. 


SQL Server 2008 and SQL Server 2005. It runs on 
Windows Server 2008, Windows Vista, Windows 
Server 2003, and Windows XP. It was tested on SQL 
Server 2008 and SQL Server 2005 in 32-bit and 64-bit 
environments. It has not been tested on—nor is it 
expected to work with—SQL Server 2000. DTLogged- 
Exec requires .NET Framework 2.0 and the SSIS 


engine. 


DTLOGGEDEXEC 


SQL] 
InstantDoc ID 100936 


BENEFITS: DTLoggedExec logs each step that’s 
executed by a SSIS package, making it easier to 
determine why a package isn’t executing 


correctly. 


SYSTEM REQUIREMENTS AND NOTES: SQL 
Server 2008 or 2005; the SSIS engine; 


Microsoft .NET Framework 2.0 


HOW TO GET IT: You can download DTLogged- 
Exec from CodePlex at www.codeplex.com/ 
DTLoggedExec/Release/ProjectReleases.aspx. 
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William Vaughn 


(Буа (0) betav.com) is an expert on Visual 
Studio, SQL Server, Reporting Services, 

and data access interfaces. He's author 

of the Hitchhiker's Guide series, including 
Hitchhiker's Guide to Visual Studio and SQL 
Server, Tth edition (Addison-Wesley). His 


website is betav.com/blog/billva. 
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SQL Server, Visual Studio, and Visual 

Basic teams come from readers and the 
people who talk to me after a workshop session and 
ask “What were they thinking when they did that?” 
Thanks to your suggestions, SQL Server Reporting 
Services (SSRS) 2008 is better. Microsoft kept al- 
most all of the good features and added a few more. 
That said, I would still like to see some things im- 
proved. Let’s visit some of the refined features that 
should make your job easier and look at a few unfin- 
ished features that stick out on the road like a dead 
moose hit by a cement truck. 


h ДЙ ost of the suggestions I make to the 


‘tual Directory 
SSRS no doner needs Microsoft IIS to be able to 
host virtual directories. Without that added IIS lay- 
er, SSRS performs quicker than before. You'll still 
need to set up a certificate to be able to access your 
reports via SSL. Running a production report with- 
out SSL is like mentioning your big sister's phone 
number on the local country-western radio station. 
With SSL, all of the chatter between SSRS and the 
browser travels over the network in encrypted pack- 
ets. While it won't make your sister forgive you, she 
won't be able to use a net sniffer to see the reports or 

the private data they contain. 
SSRS has also changed how the virtual directories 
are named, but only if you've installed SQL Server 
2008 as a named instance (as most of us have). In 


earlier versions, the ReportServer or Reports URL 
used the SQL Server instance name tacked on with 
а $ as in https://your server/Report$SS2K 5. In SSRS 
2008, Microsoft replaced the $ with an underscore 
(_). To get your Microsoft Visual Studio (VS) 2008 
BI project to deploy, you change the TargetServer 
URL to https://your server/ReportServer SS2K8 
where SS2K8 is the name of your SQL Server 
instance, as Figure 1 shows. 


This tool got a facelift, and its functionality has been 
polished. Reporting Services Configuration Manager 
(RSCM) is still launched from the SQL Server Con- 
figuration Tools menu. Remember that it's making 
configuration changes on a specific SSRS instance, 
which is often installed on a server down the hall. If 
you're installing SSRS versions later than SQL Server 
2000, this tool lets you ensure everything is hooked up 
correctly and helps you configure SSL, set up email 
links, and most importantly, set and back up encryp- 
tion keys. It's pretty tough to get your reports back 
without these keys. Figure 2 shows the Report Man- 
ager link in the RSCM. This is where you bind the 
SSL port to the certificate you created. 


SSRS still doesn’t offer an easy way to export 
reports. The SSRS team tells me that exporting re- 
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SSRS changes offer 
much-needed improvements 


reports is on their radar 
(somewhere over the Ber- 
ing Sea) and the ability 
to do so might appear in 
a future release. For now, 
you can take advantage 
of a free utility that ad- 
dresses this need: See the 
sidebar “Exporting SSRS 
Reports—For Free.” 


Enabling 

My Reports 

If you need to expose 
Report Manager to your 
users, you can enable the 
My Reports feature to 
help users maintain a di- 
rectory of reports based 
on their domain login 
name. For example, after 
I enabled My Reports, 
SSRS included a new di- 
rectory tree for my per- 
sonal reports that I could 
use to help find specific 
reports that interested me. 
The trick is enabling this 
feature. The documenta- 
tion is a bit sketchy, but 
it's not that hard to enable 
once you know the secret 
handshake. 

Start 


SQL Server 


Management Studio, but 
instead of connecting to a 


Report Demonstrations Property Pages 


Configuration: | Active(Debug) , Configuration Manager. | 


4 Configuration Properties 
General 


https-//betav l/reportserver 3328 


The report to execute when you start the debugger 


Сс) Сеа] 


Арріу 


Figure І 
Setting the TargetServer URL 


Метан SQL Sarver 2008 Reporting ұсы 


m 
EN Reporting Services Configuration Manager 


24 


Зі Connect | 
1 ВЕТАУ 16523 
Cosfigure a URL to access Report Manager. Click Advanced to define multiple URLS, orto speofy 
a Seve additional parameters се the URL. 


Аме Service URL ьалаа 


Virtual Directory: Reports 5528 
Database 
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Figure 2 
SSRS Configuration Manager 


EXPORTING SSRS REPORTS—FOR FREE 


Database Engine, choose Reporting Services from 


the initial Connect to Server dialog box (the ser- 
vice must be running for this to work). To enable 
the “My Reports” functionality, right-click the base 
connection and choose Properties. The dialog box 
shown in Figure 3, page 14, should appear. You can 
then set the role applied to each of the My Reports 
directories created on the server. When Windows us- 
ers open the Report Manager URL, they will have a 
new path created in the SSRS catalog for their do- 


main name. 
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Frankly, | would find it hardly worth the effort if | had to restore a single SSRS 
report and my only option was to restore the entire SSRS database. Thankfully, 
Jasper Smith has (apparently) mastered SOAP and the programmatic interfaces 
to SSRS and invented a free utility, Reporting Services Scripter, to suck out the 
RDL and data sources and all of the other catalog items from the database. | 
tried this utility and though it initially didn't seem to support SQL Server 2008 
(2.0.0.0.11), | was able to get it to connect to my SQL Server 2008 instance 
and script out the reports as well as create a Visual Studio ВІ project for each 
directory. This saved me the worry and trouble of propagating my test reports to 
another system. To download the utility, go to www.sqldbatips.com/showarticle 
.asp?ID-62. 
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UNLOCK SSRS 2008 


IA Server Repoting Services 
ү Матова: SOL Server Reporting Services Verson 10 0 1600 22 
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"My Reports" folder. 4 
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Figure 3 
Setting SSRS properties 


NAVIGATING MICROSOFT'S 
REPORT DESIGNER MAZE 


There are at least four people over in Building 35 on the Microsoft cam- 

pus who actually understand the reasoning behind the evolution of Report 
Designer. Each reinvention of Report Designer seems to cause stress to the 
compatibility between versions. I’ve laid out the particulars of each Report 
Designer, but that still doesn't help us understand why we can't do what we've 
been told to do when creating SSRS reports. Confused? Join the club. 

Report Designer in Visual Studio (VS) 2003 with the Reporting Services add-in 
tacked on with binary duct tape. This designer can only work with SQL Server 
Reporting Services (SSRS) 2000 RDL reports. This version of VS doesn't sup- 
port the ReportViewer control. 

Report Designer in VS 2005. This designer can't see or work with 
SSRS 2008, but it can import SQL Server 2000 Reporting Services RDL 
reports and interface with SSRS 2005. It does support the first-generation 
ReportViewer control, which can cross-pollinate with SSRS 2005 RDL 
reports. 

Report Designer in VS 2008. This designer also can't see or work with SSRS 
2008 nor can it even open SSRS 2005 projects. It still supports the first- 
generation ReportViewer control and can cross-pollinate with SSRS 2005 RDL 
reports. 

Report Designer in VS 2008 SP1. This designer does work with SSRS 2008 
and even opens SSRS 2005 projects, which it converts to the VS 2008 for- 
mat. It supports first-generation ReportViewer control projects and can cross- 
pollinate with SSRS 2005 RDL reports but not SSRS 2008 RDL reports. 

Report Designer Launched by the SSRS БІ Tools. This new VS BI designer is 
specifically designed to work with SSRS 2008 and also SSRS 2005 projects, 
which it converts to the VS 2008 BI format. It doesn't support Windows Forms 
or ASP development at all, so the ReportViewer control isn't an issue here. 
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It's vitally important to protect your reports— 
regardless of who is authorized to see them. The 
Reporting Services Object Explorer is one way to 
create specific SSRS roles to which you can assign 
specific rights. This prevents users from accessing 
reports that they shouldn't see. 


Working with the 

New Report Designer 

Actually, many report designers are available to 
SSRS developers. In the sidebar *Navigating Mi- 
crosoft's Report Designer Maze,” I attempt to lay 
out in an organized way the versions and what they 
support. 

The new SSRS 2008 Report Definition Lan- 
guage (RDL) rendering engine solves a lot of really 
ugly problems seen in the first-generation RDL 
renderers (yes, there are several first-generation 
renderers). SSRS 2008's rendering engine supports 
lots of new Rich Text Format (RTF) functionality 
as well as the new Tablix control (which isn't really a 
report control at all). The Tablix control combines 
the features of the matrix and table controls (thus 
the name) along with features such as limited sup- 
port of Rich Text and built-in pivot capabilities. 
The new SSRS 2008 rendering engine is also faster 
and more flexible. That's good. The problem is that 
the rendering engine, as well as the report design- 
ers that build RDL to feed it, created new and in- 
compatible RDL files that can't be consumed by 
the old SSRS 2005 engine that is still in use in VS 
2005's and VS 20085 Report Viewer controls. That's 
bad—at least for the people who want to use the 
easy-to-develop-your-report BI tools to build these 
new reports and leverage the ReportViewer control 
in Windows and Active Server Pages (ASP) appli- 
cations to deploy them. You see, behind the scenes, 
the VS 2008 SP1 ReportViewer control knows 
only how to render the old, first-generation RDL- 
style reports. However, an upgrade to VS and the 
ReportViewer control to incorporate the next- 
generation RDL renderer is underway. Unfortu- 
nately, we won't see the change (despite consider- 
able pressure) until VS 2010. 


The SSRS Story Continues 
SSRS has many more facets that I hope to lay 
out for you during this year while Microsoft fin- 
ishes work on the rest of SSRS. I expect SSRS 
to take on a life of its own as more and more ar- 
chitects and developers discover it's far easier 
to put together a complex UI that includes par- 
ent-child relationships, sums, totals, complex 
expressions, and embedded code than it is to hard 
code these elements by hand. En 
InstantDoc ID 101197. 
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SQL Server 2008's 


T-SQL Features 


Small new features provide big benefits 


henever a new version of SQL Server is 
W released, there's a lot of talk about the big 

new features. But in this article, rather than 
focusing on SQL Server 2008’s big features, ГЇЇ cover 
smaller improvements that you might have overlooked. 
ГЇЇ discuss the enhanced VALUES clause, support for 
the ISO week system, and new conversion options 
between binary and character types. 


VALUES Clause 
SQL Server 2008 introduces support for a row value 
constructor (also known as a table value constructor). 
Using the VALUES clause, you can now represent 
more than one row. The obvious scenario in which you 
might want to use this option is to use a single INSERT 
statement to insert multiple rows into a table rather 
than needing to use multiple INSERT statements. To 
demonstrate this capability, first run the code in Listing 
1 to create a table called Orders in the tempdb database 
(for test purposes). 

The following code demonstrates how to use the 
enhanced VALUES clause with a single INSERT state- 
ment to insert six rows: 


INSERT INTO dbo.Orders 
(orderid, orderdate, empid, custid) 


VALUES 
(10001, '20090212', 3, "А9, 
(10002, '20090212', 5, "В9, 
(10003, '20090213', 4, 'B'), 
(10004, '20090214', 1, "А9, 
(10005, '20090213', 1, "С9, 
(10006, '20090215', 3, 'C'); 


As you can see, each pair of parentheses represents a 
single row, and you separate the rows with commas. 
Besides the obvious benefit of shortening your code, 
another benefit of using a single statement is that the 
operation is considered atomic. If any of the rows fails to 
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enter the target table, the entire INSERT statement fails. 

Prior to SQL Server 2008 you could achieve a 
similar capability by performing a UNION ALL 
operation between several SELECT statements based 
on constants, like so: 


INSERT INTO dbo.Orders 
(orderid, orderdate, empid, custid) 


SELECT 10001, '20090212', 3, "А" 
UNION ALL SELECT 10002, "20090210", 5, 'B' 
UNION ALL SELECT 10003, "20090213", 4, 'B' 
UNION ALL SELECT 10004, "20090214", 1, "А" 
UNION ALL SELECT 10005, '20099213', 1, 'C' 
UNION ALL SELECT 10006, "20090215", 3, 'C'; 


In fact, the current implementation of the 
enhanced VALUES clause is internally han- 
dled like this UNION ALL solution—so 
don't expect any performance improvements. 
One benefit is that the VALUES clause is 
standard, whereas the solution based on 
UNION ALL isn't, because the queries don't have 
FROM clauses. We can only hope that in a future ver- 
sion of SQL Server, the VALUES clause will also pro- 
vide performance benefits over the existing technique. 

Note that you're not restricted to using a table value 
constructor only with an INSERT statement. You can 


LISTING 1: Code to Create 
the Orders Table 


USE tempdb; 

IF OBJECT ID('dbo.Orders', 
dbo.Orders; 

CREATE TABLE dbo.Orders 

(6 
orderid INT NOT NULL 

CONSTRAINT PK_Orders PRIMARY KEY, 

orderdate DATE NOT NULL 


CONSTRAINT DFT orderdate DEFAULT (CURRENT_TIMESTAMP) , 


empid INT NOT NULL, 
custid УАКСНАК(10) NOT NULL 


'U') IS NOT NULL DROP TABLE 


Itzik Ben-Gan 


itzik@ solidg.com) is cofounder of Solid 
Quality Mentors. He manages the Israeli SQL 


Server Users Group and is the author of 
Microsoft SQL Server 2008: T-SQL Fundamentals 
(Microsoft Press, 2008) and coauthor of the 
Inside Microsoft SQL Server 2008: Inside T-SQL 
series (Microsoft Press, 2009). 
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source code at 
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also use it to construct a derived table that you query 


in an outer querys FROM clause, like so: 


SELECT * 

FROM ( VALUES 
(10001, '20090212', 3, “А9, 
(10002, '20090212', 5, "В'), 
(10003, '20090213', 4, "В'), 
(10004, '20090214', 1, "А9, 
(10005, '20090213', 1, 'C'), 


TABLE |: Output of VALUES 


Clause Query 


ordered orderdate empid custid 
10001 20090212 3 А 
10002 20090212 5 B 
10003 20090213 4 B 
10004 20090214 íl A 
10005 20090213 1 C 
10006 20090215 3 @ 
TABLE 2: сири of Query 
Calculating ISO Week 

dt weeknum weekday 
2008-12-28 52 Sunday 
2008-12-29 1 Monday 
2008-12-30 1 Tuesday 
2008-12-31 1 Wednesday 
2009-01-01 1 Thursday 
2009-01-02 1 Friday 
2009-01-03 1 Saturday 
2009-01-04 1 Sunday 
2009-01-05 2 Monday 


LISTING 2: Code to Create ISO Week UDF 


USE tempdb; 
GO 
IF OBJECT ID (N'dbo.ISOweek', N'FN') IS NOT NULL 
DROP FUNCTION dbo.ISOweek; 
GO 
CREATE FUNCTION dbo.ISOweek (@DATE datetime) 
RETURNS int 
AS 
BEGIN 
DECLARE @ISOweek int 
SET @ISOweek= DATEPART (wk, GDATE) +1 


-DATEPART (wk, CAST(DATEPART(yy,GDATE) as СНАК(4) )+'0104') 


--Special cases: Jan 1-3 may belong to the previous year 
IF (GISOweek-0) 


SET @ISOweek=dbo. ISOweek (CAST (DATEPART (yy , GDATE) -1 
AS CHAR(4))+'12'+ CAST(24+DATEPART (DAY, @DATE) AS 


CHAR(2)))+1 
--Special case: Dec 29-31 may belong to the next year 
IF CCDATEPART(mm,@DATE)=12) AND 
CCDATEPART (dd , GDATE) -DATEPART (dw, GDATE))»- 28)) 
SET GISOweek-1l 
RETURN (QGISOweek) 
END; 
GO 
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(10006, '20090215', 3, 'C') ) 
AS OCorderid, orderdate, empid, custid); 


Table 1 shows this query's output. 

I find this capability useful whenever I need to 
create a small auxiliary table made of constants for 
the purposes of a query. Now you dont need to 
create a temporary table or table variable, or use the 
nonstandard UNION ALL technique for this pur- 
pose. Still missing, however, is the ability to define a 
common table expression (CTE) based on a table value 
constructor. For now, the technique works only with 
derived tables. 


ISO Week 

The ISO week system is a week-numbering system 
used mainly in European countries. The first day of 
the week is always Monday. All days of the same 
week have the same week number, even if the week 
spans two years (i.e., end of December and beginning 
of January). If a week spans two years, whether the 
week number is the last in the first year (1.е., week 
52 or 53) or the first in the second year (1.е., week 1) 
depends on which year the week's Thursday occurs. 
For example, take the week starting on Monday, 
December 29, 2008, and ending on Sunday, January 
4, 2009. The Thursday of that week falls in the year 
2009 (January 1), hence all days of that week get 
week number 1. 

SQL Server 2008 introduces a simple and efficient 
way to calculate an ISO week number. You get a new 
part called ISO WEEK in the DATEPART function. 
The following code shows an example of calculating an 
ISO week number using the DATEPART function for 
a set of input dates: 


SELECT 
CAST(dt AS DATE) AS dt, 
DATEPART(ISO WEEK, dt) AS weeknum, 
DATENAME (weekday, dt) AS weekday 
FROM ( VALUES 
('20081228'), 
( 20081229"), 
( 20081230"), 
(720081231), 
(720090101), 
(720090102 "), 
(720090103, 
(720090104), 
(720090105) ) AS D(dt); 


Table 2 shows the output of this code. 

Prior to SQL Server 2008 you had to implement 
your own manipulation to calculate an ISO week 
number for a given date. For example, Listing 2 shows 
the definition of a scalar user-defined function (UDF) 


SQL Server Magazine * www.sqlmag.com 


we March 2009 
te | 
sséntial Guide to 


7 


Row. else { 


СА „ы .- ж. 


і-.з 


ғар 1 


(z 


usiness Intelligence (ВІ) is about extracting 
useful business information from the huge 
mass of data that enterprises collect in their 
transactional systems (HR, finance, sales). 
The data, combined from the different 
transactional systems and aggregated, 
delivers this information. 


In a typical enterprise there are three major barriers 

to ВІ: 

1. The data is dispersed across multiple source systems 

2. The data quality in the source systems is usually poor 

3. Relational databases are generally poor at running 
analytical queries 


In order to solve problems one and two, most ВІ 
Systems use an ETL process to Extract the data from 

the transactional systems, Transform it to improve the 
quality and Load it into a central repository called a data 
warehouse. 


As problem three suggests, analytical queries are 
fundamentally different from transactional ones 

and place very different demands on the database. 

For example, a transactional query to return the 

most recent order placed by a customer might hit 

ten rows. An analytical query to return the average 
sales of cat food in Kansas, month by month could 
potentially hit tens of millions of rows. We solve this 
problem, once the data has been brought together 

in the warehouse, by extracting subsets of the data, 
restructuring it for analytical processing and placing it in 
data marts. In structural terms the data is typically held 
in a multi-dimensional database; in functional terms 
these structures are called OLAP (On-Line Analytical 
Processing) cubes. OLAP essentially allows users to 
query the data very rapidly and intuitively. 


In addition, ВІ systems typically offer Data Mining 
capabilities. There are many different data mining 
algorithms but essentially all are designed to scan large 
data sets and expose trends, exceptions, groupings and 
other hidden information. 


The combination of Intel and Microsoft offers a ВІ 
platform that has proved unbeatably attractive in terms 
of integration and price-performance. In the early 
19905 BI was fearsomely expensive and dominated 

by companies such as IBM, Hyperion, Cognos and 
Business Objects. When Microsoft released SQL Server 
7.0 (1998) on the Intel platform it bundled the ВІ stack 
into the box at no extra cost. This pricing structure 
didn't simply upset the ВІ applecart; it reduced the cart 
to matchwood, pulped the apples and flushed the juice 


down the drain. Ten years later and not surprisingly, 
the combination dominates the market. The highly 
respected OLAP report from Nigel Pendse puts the 
combination far ahead of the rest in terms of market 
share.' And this isn't just about price. For example, as 
an estimate of OLTP performance (important for data 
warehousing) Intel and Microsoft exhibits leadership 
performance with the TPC-E benchmarks for both 
performance and price. 


Finally ВІ assumes an even greater importance in the 
current economic climate. Economic instability means 
greater uncertainly and faster change. Previously 
dependable suppliers suddenly disappear; the spending 
pattern of your mid-range customers starts to change 
and so on. A good BI system should be able to not 

only detect changes but also allow you to run ‘what-if’ 
scenarios and predict knock-on effects. Ultimately, during 
a recession, the companies that survive are those that can 
adapt rapidly. BI allows you to do precisely that. 


Business Intelligence Defined 


In SQL Server 2005 and 2008 the ETL component is 
SSIS (SQL Server Integration Services), replacing the 
DTS (Data Transformation Services) which served in SQL 
Server 7.0 and 2000. 


At the heart of any ВІ system is the data warehouse. There 
are two schools of thought about how the data should be 
structured in the warehouse - followers of Ralph Kimball 
tend to favor a star schema, supporters of Bill Inmon 
favoring a more normalized structure. No matter which 
structure is chosen, the data in the warehouse is typically 
held on a relational engine and in the Microsoft BI stack, 
this heart is provided by SQL Server. 


For OLAP Microsoft provides the world class multi- 
dimensional engine, Analysis Services. For data mining, 
SQL Server 2008 has nine algorithms. 


ВІ ‘Gotchas’ 


To make the best of the software we have identified 

a set of best practices. Most of these relate to the 
software but, in practice, some of the greatest 
challenges faced by BI architects are not technological; 
rather they are more concerned with people, 
definitions, requirements gathering and politics. 


For example, it's common for business users to decide 
that a ВІ system is needed. A technical team is assembled, 
resourced and set to work. It is sometimes expected to 
produce an information system without any further input 
from the commissioning business users, who see the task 
as a technical one from which they sit apart. 


In practice, some of the greatest challenges 
faced by ВІ architects are not technological; rather they 
are more concerned with people, definitions, 
requirements gathering and politics. 


Now imagine а ВІ specialist trying to create a definitive 
customer list in the data warehouse from a likely- 
looking "Customer" table in one of the source 
Systems. 


The reality is that within different departments in the 
enterprise, the term "customer" will be used in many 
different ways; meaning, for example: 

* new customers 

* current customers 

* business customers 

* trade customers 

* top-spending customers 


With such variety of meaning, one single definition of 
‘customer’ is clearly impossible. The ВІ system must 

be able to deliver all of the definitions above. Equally 
Clearly, this can only be done with considerable input 
from the users—so it is impossible for technical staff to 
produce an information system in isolation. 


This problem is addressed by one of the most crucial 
parts of building a ВІ system - requirement gathering— 
and prior to starting this task it is equally crucial to 
convince business users that it is they and they alone 
who can provide the input to this process. 


Non-technical problems run deeper. Interdepartmental 
or interpersonal politics also turn out to be hugely 
important. For instance, department head A is asked 
to make data available which will benefit department 
head B. If antipathy exists between these two, despite 
the protestations of co-operation, all manner of 
obstructions may appear. This issue is non-trivial and 
has been a major cause of failure in ВІ projects since 
they started. Indeed this was highlighted in.an IDC 
survey in 1996? and again in a Gartner survey. 

in 2005.3 


On the technical side, one question you will never be 
asked is "Can you make the system.a bit slower?" 

So many of our best practices relate, either directly or 
indirectly, to performance. 


ВІ Best Practices 


Best practice: find a sponsor. This is essential- Do 
not start a ВІ project without one. The sponsor is your 
main weapon for dealing with non-technical problems. 
Ideally the sponsor should be at the very top of the 
organizational tree with the authority and influence 

to clear a path to success for the entire ВІ project. 
When the authoritative sponsor leans forward and 
gently breathes "Do it," the intransigent stances of 
department heads and others evaporate. 


Best practice: Choose your "proof of concept" 
(POC) project carefully. Pick a small discrete aspect 
of the business for a project that's easy to accomplish 
and has a high ROI. This has two beneficial effects: 
firstly the costs for the overall start-up can be kept 
down and it produces results fast. This POC project 

is your chance to show users how wonderful the BI 
system can be; if you enthuse people early on, you nip 
many obstacles in the bud. 


Best practice: Inspect the distribution of data in 
the source systems. The Data Profiler, part of SSIS, 
lets you do just this in preparation for defining the data 
transformations. Once the domain of values present in 
each column of a source database is known, it can be 
compared with data gathered from those familiar with 
the domain. These steps let you create transformations 
that ensure clean data is loaded into the warehouse, 
resulting in greater accuracy during analysis. 
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Best practice: specify sufficient memory in the * 
warehouse. Access to warehoused data is far from uni- ~ 
form and а Microsoft study has shown that most queries а 
tend to hit the same 20 percent of the data. So specifying 
sufficient memory to hold around 20 percent of the data 
should make a significant improvement to performance. 


Best practice: Use the power that modern R n 
hardware offers. You can speed up any database S 
by tuning; you can also throw hardware at the 

performance issues. In the past hiring a tuning 

consultant was often cost effective but modern 

advances in hardware have removed the pejorative sting 

from those words "throw hardware." Hardware is now 

a very, very cost effective option. 


The server carries out almost all of the very processor- -- 
intensive tasks, such as aggregation and mining. Here 

you should look to 64-bit, if for no other reason than 

it means you can "fit and forget" more RAM. The 

Intel Xeon 7400 series supports up to 256GB of RAM, 4 
which is enough to accommodate the entire data 
warehouse of many small- to medium-sized enterprises. 
In addition, 4-socket motherboards are now widely 
available in the server world and can be populated with 
Intel Xeon 7400 processors with up to 6 cores. 


To put all of this into perspective, for about $30,000 you 
can buy a 4-socket server, populated with four 7400 
processors, each with six cores. So you end up with 24 
64-bit cores. This is an immensely powerful machine. 


If you need more processing power than that (and very 
large ВІ systems will) then scaling out may help. ^ 


Best practice: Accommodate the favored 
presentation methods of your users. If your users 
are devoted spreadsheet users, give them information 
from the BI system in spreadsheet form. This not only 
keep them on-side (people are rarely happy when 8 
changes to working practices are forced upon them) 
but it also maintains efficiency and productivity. Tools 
to transform reports into Word documents are provided 
in SQL Server and there's also a comprehensive Excel 
renderer, which supports features such as sub-reports 
and nested data regions. 


Best practice: Use the resource governor to 
allocate resources. The various jobs that are run 
against a warehouse, of which loading data and 
running reports are just two examples, compete 

for the available resources. SQL Server 2008 has a 
resource governor which enables resources to be 
divided between resource pools. Up to twenty pools 
are supported, giving much more flexibility than was 
available in the 2005 version where resources sat in a 
single pool. 
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Best practice: Reduce data volume using PAGE 
compression. SQL Server 2008 supports both row 

and page data compression, and page compression can 
typically bring data volumes down by two-thirds. It offers 
the additional bonus of improving query speed. When the 
rows on a page are compressed: the common values are 
stored in a page-level dictionary and common prefixes to 
values are stored just once per page. Queries are speedier 
because fewer read operations are needed to gather the 
data in the compressed format and also because less data 
is stored, more of it can be held in memory. 


Best practice: Use MOLAP writeback in preference 
to ROLAP writeback. In SQL Server versions prior 

to 2008, it was obligatory to use a ROLAP partition 

to hold writebacks. (The ability to write data back to 

a cube is of particular use in forecasting and "what 

ІР applications). Now you have the option to use a 
MOLAP partition for writeback which offers faster data 
retrieval as the need to query a relational data structure 
is removed. The improvement in query performance 
(which can be up to five times faster) outweighs the 
slightly slower writeback commit times under MOLAP. 


Best practice: The Analysis Management Objects 
(AMO) warnings can offer good advice. Finally, 
Analysis Services 2008 will alert you whenever best 
practice is not being followed: suggestions and 
warnings are delivered by AMO and are identified by 
a curvy blue line underneath the object in question. 
The message is displayed when you hover over the 
underlined object. Each message encapsulates an 
aspect of best practice for design or implementation, 
depending on your current task. 


Best practice: Plan to partition large tables. Some 
system management tasks, like indexing and extracting old 
data, become very time consuming with large tables. Fact 
tables in particular can become large, a rough and ready 
estimate of ‘large’ being anything over 50GB. Partition 
such giants for speedier management operations. Older 
data can be split out, by date if required, and managed 
with a storage and back up regime that best fits usage of 
that data. Newer data that is likely to be updated can also 
be partitioned and managed accordingly. 


Indexed views of partitioned fact tables are supported 
in SQL Server 2008 and if the views and table are 
partitioned using the same partition function, it is 
possible to include partitions into the view or exclude 
them as required. 


Best practice: Plan to age out old data. A data 
warehouse lets business users investigate the 
organization's activities over time and that means 
loading huge amount of data into the warehouse. 

As the data becomes older, users tend to access it 
differently; it's rarely inspected at the most detailed level 
as users choose to look at aggregated values, and it's 
also used less frequently. As time marches on, it will 
become necessary to handle older data differently. For 
a start, you might move it to slower (cheaper) disks. 
You may also decide just to store the aggregates. 
Partitioning often makes the aging-out process easier. 


More best practices for SQL Server are available in a 
Microsoft white paper on the subject.^ 


Technological Advances 


Intel has produced the excellent 7400 series of multi- 

core processors and the 6-core version has been 

available to the public since late last year. SQL Server 

(and Analysis Services) can make full use of these cores 

and their use can, as discussed in best practices, lead to 

very powerful and cost effective machines that are very 

well suited to ВІ. i 


Coming to SQL Server in 2010 is an update of SQL 
Server, currently called “Kilimanjaro.” This is not the 
next release of SQL Server; it is described by Microsoft 
as an update that focuses more on the BI side than on 
the relational engine. 
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One major component of Kilimanjaro will be “Madison,” 
which indirectly addresses the Kimball/Inmon debate 
about how we structure data in the warehouse. 
DATAllegro was a data appliance company that 
specialized in allowing analytical queries to run against 
relational databases. Microsoft bought DATAllegro in 
mid-2008 and Madison is essentially the DATAllegro 
technology incorporated into SQL Server. The first 
implication of this is that SQL Server should be able to 
comfortably handle data warehouses with hundreds of 
terabytes of data. However, that ability may also encourage 
more enterprises to think about using a normalized 
structure in the warehouse rather than a star schema. 
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Another component of Kilimanjaro, code named 

"Gemini," makes use of a new in-memory column store. 

Essentially this makes it much easier for end users to mix 

and match data from different sources for analysis in Excel. 

At the most recent BI conference in Seattle Microsoft 

demonstrated the virtually instantaneous manipulation of 

100 million rows of data in Excel. з 


Dr. Mark Whitehorn is а mentor with Solid Quality 
Mentors, specialising in ВІ. In addition he has written about 
databases and BI for the last 20 years, publishing 11 books 
and over 2,500 articles. He has been leading ВІ projects 

for many years and was invited by Microsoft recently to 
help define the role of BI architect. On the academic side 
he is a senior lecturer at Dundee University and a research 
associate at the University of Cambridge. His research work 
involves applying ВІ techniques to scientific data. 
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! The OLAP report - OLAP market share analysis 
http://olapreport.com/market.htm 


? The Foundations of Wisdom: A Study of the Financial Impact 
of Data Warehousing. International Data Corporation (IDC), 
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Limited Acceptance or Will Be Failures Through 2007: Gartner 
Business Intelligence Summit, Chicago, March 2005 
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Best Practices for Data Warehousing with SQL Server 2008, 
icrosoft, July 2008 (http://technet.microsoft.com/en-us/ 
ibrary/cc719165.aspx) 


TABLE 3: Bin to Char Conversion 
bin to char no prefix 


bin to char with 0x prefix 


0x4775696E6E657373 


to calculate an ISO week number taken from SQL 
Server 2005’s Books Online under the subject CREATE 


FUNCTION. 


As you can see, the definition of the func- 


tion is quite convoluted. Also, scalar UDFs 
incur a high-performance penalty when 
invoked against a table per row. The fol- 
lowing code shows an example for using 
this function against a set of dates: 


SET DATEFIRST 1; 


SELECT 

CAST(dt AS DATETIME) AS dt, 

dbo.ISOweek(dt) AS weeknum, 

DATENAME (weekday, dt) AS weekday 
FROM ( SELECT '20081228' 
UNION ALL SELECT '20081229' 
UNION ALL SELECT '20081230' 
UNION ALL SELECT '20081231' 
UNION ALL SELECT "20090101! 
UNION ALL SELECT "20090102" 
UNION ALL SELECT "20090103! 
UNION ALL SELECT "20090104" 
UNION ALL SELECT "20090105" ) 
AS D(dt); 


Binary-Character 
Conversion 

Another of SQL Server 20085 small fea- 
tures is one that has to do with conver- 
sions between binary and character data. 
When you use the CONVERT or CAST 
functions to convert binary to character 
data or the other way around, you don’t 
get the same characters in the source and 
target values. For example, when con- 
verting the character string ‘1A’ to binary 
you normally get the binary representation 
of the characters: 0x3141. Similarly, when 
converting the binary string 0x3141 to 
character, you get the characters that this 
binary data represents: ІА.’ 

In certain cases you might need to con- 
vert binary data to character or character 
to binary data such that each digit in the 
source value is represented by the same 
digit in the target. That is, the string ‘1A’ 
(or '0xLA with the Ох prefix) would be con- 
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verted to the binary value with those hex digits: 
Ox1A, and Ox1A would be converted to the 


string ‘1A’ (or ‘Ox1A’ with the Ox prefix). This 
capability is sometimes useful for importing 


4775696E6E657373 data. 


SQL Server 2008 introduces a simple and 


efficient solution in the form of new style numbers in 
the CONVERT function. Style 0 represents the default 


pre-SQL Server 2008 behavior. Style 1 should be used 
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TABLE 4: Char to Bin Conversion 
char with Ох prefix to bin char no prefix to hin 


0x4775696E6E657373 


LISTING 3: Code to Create fn chartobin UDF 


USE tempdb; 
GO 


0x4775696E6E657373 


IF OBJECT ID (N'dbo.fn chartobin', N'FN') IS NOT NULL 
DROP FUNCTION dbo.fn chartobin; 


GO 


CREATE FUNCTION dbo.fn chartobin(Gchar AS VARCHAR(MAX)) 


RETURNS VARBINARY (MAX) 
AS 
BEGIN 

DECLARE 


@result AS VARBINARY (МАХ), 


Qi AS INT, 
Gnumbytes А5 INT, 


@leftdigit AS BINARY(1), 
Grightdigit AS BINARY(1); 


-- Input validation 


IF @char LIKE "0х%ГЛй-да-еА-Е1%! 
OR (@char NOT LIKE '@х%' AND @char LIKE '%[A@-9a-eA-E]%') 


RETURN NULL; 


-- remove Ox if exists 


IF @char LIKE '@x%' SET @char = STUFF(@char, 1, 2, ''); 
-- add 0 at beginning if odd number of digits 
IF LEN(@char) % 2 = 1 SET @char = 'Ø' + @сһаг; 


SET €i = 1; 


SET @numbytes = LEN(@char) / 2; 


SET @result = 9x; 
WHILE Qi <= @numbytes 
BEGIN 


SET @result = Gresult + 
СА5Т(СА5Т(СА5Е UPPER(SUBSTRING(@char, Qi, 1)) 


WHEN 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
WHEN ' 
END 
AS TINYINT) 
| 


СА5Т(СА5Е UPPER (SUBSTI 
WHEN 'Q' TH 


2 


T m Q P о > ооо мочол шогон 


THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 
THEN 


0x00 
9x18 
0x20 
9x30 
9x40 
9x50 
9x60 
9x70 
9x80 
0x90 
@хА@ 
@хВ@ 
йхС@ 
®xDB 
ØxEØ 
@хЕ@ 


RING(@char, @i+1, 1)) 


0 ЕМ 0х00 
WHEN "1" THEN 0x01 
WHEN '2' THEN 0x02 
WHEN '3' THEN 0x03 
WHEN '4' THEN 0x04 
WHEN "5" THEN 0x05 
WHEN "6" THEN 0x06 
WHEN '7' THEN 0x07 
WHEN '8' THEN 0x08 
WHEN '9' THEN 0x09 
WHEN "А" THEN @x@A 
WHEN "В" THEN 0x0B 
WHEN "С" THEN 0x0C 
WHEN 'D' THEN 0x0D 
WHEN 'E' THEN 0xQE 
WHEN "Р" THEN 0xQF 


END 
AS TINYINT) 
AS BINARY(1)); 


SET @ = Qi + 2; 
END 


RETURN Gresult; 


END; 
GO 
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when the character string has a Ox prefix, and style 2 
should be used when it doesn’t. As an example, the fol- 
lowing code demonstrates conversion of a binary value 
to a character string using both styles: 


SELECT 
CONVERT (МАКСНАК (20), 0х4775696Е6Е657373, 1) AS 
bin to char with x prefix, 
CONVERT(VARCHAR(28) , 0х4775696Е6Е657373, 2) AS 
bin to char no prefix; 


Table 3, page 17, shows the output of this code. 
The following code demonstrates conversion of 
character strings to binary values using both styles: 


SELECT 
CONVERT(VARBINARY(18), '0х4775696Е6Е657373', 1) 
AS char with 0x prefix to bin, 
CONVERT(VARBINARY(18), '4775696E6E657373', 2) 
AS char no prefix to bin; 


Table 4 shows the output of this code. 

It was possible to achieve similar behavior prior 
to SQL Server 2008, but you had to use scalar 
UDFs—so the solution was much slower. SQL 
Server 2005 and SQL Server 2000 provide a built-in 
UDF called fn varbintohexstr that does the binary 
to character conversion. Here's an example for using 
the function: 


SELECT sys.fn_varbintohexstr (0x4775696E6E657373) ; 


Internally, this function calls a more flexible func- 
tion called fn varbintohexsubstring. This function 
accepts four arguments. The first indicates whether 
to include the 0х prefix in the output (1) or not (0). 
The second is the binary value. The third indicates in 
which byte to start extracting the substring (use 1 for 
beginning), and the fourth indicates how many bytes 
to consider (0 for all). So the above call to the function 
fn varbintohexstr is equivalent to the following call to 
fn varbintohexsubstring: 


SELECT sys.fn varbintohexsubstring(1,0x4775696E6 
Е657373,1,0); 


If you're curious about the T-SQL definition of the 
function, you can find it by running the following 
code: 


SELECT ОВЈЕСТ DEFINITION(OBJECT ID('sys.fn 
varbintohexsubstring')); 


As you can see, the function is quite long and convo- 
luted. If you need to perform such conversions, you'll 
appreciate the simplicity, elegance, and efficiency of the 
new option using the CONVERT function. 

Pre-2008 versions of SQL Server did not provide 
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an option for converting the other way around; 
namely, from character to binary. As long as you don't 
need to implement this logic in a function, and need to 
operate on a single value, you can use a neat trick that 
I learned from my friend Ron Talmage. You simply 
construct a dynamic batch where you concatenate the 
character representation of the binary value as part 
of the code as an assignment of a binary value to a 


to convert character to 
binary and binary to 
character values while 
preserving the hexadec- 
imal digits. Next month 
ГЇЇ cover some additional 
SOL Server 2008 fea- 
tures that you might find 


Besides the obvious benefit 
of shortening your code, 
another benefit of using 

a single statement is that 
the operation is considered 


parameter, like so: 
Char to Bin рге-2008 


Using dynamic SQL 
DECLARE 
@char AS NVARCHAR(28) , 
(ріп AS УАКВІМАКУ (19), 
0541 AS NVARCHAR(500) ; 


SET @char = N'0x4775696E6E657373' ; 


SET 0541 = N'SET @result = ' + @char 
+ N's! 

EXEC sp executesql 
(stmt = 0541, 
@params = N'@result AS VARBINARY(10) 
OUTPUT', 
@result = Gbin OUTPUT; 


SELECT Gbin; 


But if you want to be able to invoke the 
conversion in a query against a table, you 
must implement it as a UDF. You can use 
the function fn. chartobin that's provided in 
Listing 3 for this purpose. 

The function extracts from the input 
string one pair of digits at a time (since each 
pair represents a byte), produces the cor- 
responding binary byte, and concatenates 
it to the result binary string. The function 
can accept the input with or without the 
Ox prefix. To test the function, run the fol- 
lowing code: 


SELECT dbo.fn chartobin('0x4775696E6E6 
57373); 


The output will be the binary value 
0х4775696Е6Е657373. 


Not Much Ado About 
Something 

It's easy to overlook some of the T-SQL 
enhancements in SQL Server 2008, espe- 
cially because Microsoft hasn't made a lot 
of fuss about them. Three small features 
that you might find handy include the 
enhanced VALUES clause, improved ISO 
week number calculation, and the ability 
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the Numbers Table 
You Need 


A custom tool skirts the limitations of 


traditional techniques 


the database world, a numbers table, or 
| n tally table, is simply a table of unique 

integers. These one-column tables usu- 
ally start with a value of 1, increment by 1, and end 
at some fixed integer. Developers can often use them 
to eliminate cursors and loops, parse strings, optimize 
queries, identify number sequence gaps, and more. A 
Google search for “tally table" or “numbers table” 
shows many different ways to build them, but the tech- 
niques generally have drawbacks. The techniques might 
themselves involve cursors, loops, or identity columns; 
cursors and loops usually run slowly, and identity col- 
umns can become a hassle. The techniques might need 
temporary tables or actual database tables, which could 
place expensive demands on database server resources. 
Finally, the techniques lack the flexibility for a devel- 
oper who needs a different kind of numbers table: one 
that has starting—and maybe ending—negative values 
or increment values greater than 1. 

To get around almost all these drawbacks, I wrote 
CreateIntegersTable, the multistatement table-valued 
function shown in Listing 1, page 22. Written for 
SQL Server 2005, CreateIntegersTable takes input 
parameters @start_int, @step_int, and @end_int and 
returns a single-column table variable of type BIGINT. 
CreateIntegersTable relies on a common table expres- 
sion (CTE) and simple table inserts. Although it uses 
one WHILE loop, the loop is executed infrequently—a 
60-million—row result set, for example, loops at most 11 
times. CreateIntegersTable avoids cursors, temporary 
tables, database tables, and identity columns. It handles 
both positive and negative start and end values as well 
as step values greater than 1. It can even make full use of 
the BIGINT space, both in the data type of the numbers 
themselves and in the total number of rows returned. 
Almost all the variable names in function CreateInte- 
gersTable апа ActualEndIntegerCalculator, a related 
function explained later, include “int,” to clarify that 
these functions deal only with integers and big integers. 
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Understand It 

Although CreateIntegersTable starts with USE 
[master], the function can go in any database. The 
script drops the function if it already exists in the 
target database, then creates a fresh instance of the 
function. The @start_int and (Qstep int parameters 
default to 1. 

The function assumes that the first integer in the 
integer range is at least 1. The function handles @start_ 
int values greater than 1 later on, but a (start. int value 
less than 1 needs special handling. When the start value 
is less than 1, the IF test adds ABS(@start_int) to the 
(GQend int value. Because the function builds ranges 
starting at 1, not 0, it also adds 1 to (gend int to com- 
pensate by shifting the end value. 

The IntegersTableFill CTE (callout A) inserts rows 
into @IntegersTable, the table variable that holds 
the generated integers, up to a maximum 
@end_int value of 32,767. Variable (gend | 
int specifies the maximum value in the table; 
because the function has a default (Әзер int 
value of 1, the (gend int value of 32,767 
applies to both the maximum value in the table and the 
number of rows in the table. If the function receives a 
(Qstep int value greater than 1, however, the number of 
rows in the table at this point will be less than 32,767, 
while the maximum value in the table remains 32,767. 
Using a CTE is fast, and for this initial set of rows, 
it has high performance. Plus, the maximum number 
of rows involved, 32,767, makes the function's other 
features possible. Parameter @step_int increments the 
integers correctly. If (gend int is less than 32,767, the 
CTE WHERE clause uses (gend, int instead of 32,767. 
This behavior improves efficiency, as I explain later. 

The CTE OPTION (MAXRECURSION 32767) 
limit forces an (gend int maximum of 32,767. The 
MAXRECURSION option allows only 32,767 levels 
of recursion, which would mean a maximum of 32,767 
integers. We could specify (MAXRECURSION 0) or 
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LISTING І: CreatelntegersTable 


USE [master] 
GO 


IF OBJECTPROPERTY(OBJECT ID('dbo.CreateIntegersTable'),'IsTableFunction') = 1 


BEGIN 
DROP FUNCTION dbo.CreateIntegersTable 
ND 


GO 
CREATE FUNCTION [dbo].[CreateIntegersTable] 
@ 
Qstart int BIGINT = 1, 
Qstep int BIGINT = 1, 
бепа int BIGINT 
RETURNS GFinishedIntegersTable TABLE 
ints BIGINT 
AS 
BEGIN 
/* Table variable @IntegersTable holds finished Integer list. */ 
DECLARE @IntegersTable TABLE 


ints BIGINT 
) 


/* If the user picked ап Gstart int value less than 1, shift the @end_int value. */ 


IF (Gstart int < 1) 
SET Gend int = (@епа int + ABS(Ostart int) + 1); 


A; Common table expression to build list of Integers less than 32,767. */ 


WITH IntegersTableFill (ints) AS 
: SELECT 
СА5Т(1 AS BIGINT) AS 'ints' 
UNION ALL 


SELECT (T.ints + Gstep int) AS 'ints' 
FROM IntegersTableFill T 
WHERE ints <= (C 
CASE 
WHEN (@епа int <= 32767) THEN @епа int 
ELSE 32767 
END 
) 
) 


INSERT INTO GIntegersTable 
SELECT ints 

FROM IntegersTableFill 

OPTION ( MAXRECURSION 32767 ) 


/* This block handles @епа int > 32,767. */ 


IF (Gend int » 32767) 
BEGIN 


DECLARE (last int inserted BIGINT 
DECLARE Qint row groups INT 
DECLARE Gcurrent row group SMALLINT 


/% Figure out how many row groups the function needs for @епа int rows. */ 


(By The WHILE loop uses variable Gint row groups. */ 
SET Gcurrent row group - 1 


WHILE (Gcurrent row group <= Gint row groups) 
BEGIN 


SELECT (1ав% int inserted = MAX(ints) FROM @IntegersTable 
/% 


Іп each group, make row inserts into @IntegersTable, 
starting at QGlast int inserted and ending at 
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SELECT Gint row groups = CEILINGCCLOGC(Gend int * 1.0)/65534))/LOG(2)) + 1 


even leave this line out of the function, but then 
nothing would protect the function from infinite 
recursion, which would crash it. 

The next IF test (callout B) deals with 
@end_int values that exceed 32,767. Although 
the IntegersTable CTE that I just described works 
for values less than or equal to 32,767, numbers 
larger than 32,767 require something else because 
of the MAXRECURSION limit. For such end 
values, the function uses an INSERT INTO with 
a SELECT (callout E) that doubles the number 
of integers already in @IntegersTable. In other 
words, this particular INSERT INTO can handle 
row insertions only in successive groups of 2" 
power (2 ^ n) multiples of 65,534 (64K B) rows. 
Figure 1 shows these calculations. 

The function inserts as many integers as we 
want, up to the BIGINT limit, but starting at 
integer 32,768, it must do so in steps, using a 
SELECT statement to double the number of rows 
already in @IntegersTable before it inserts new 
rows. Therefore, the function must figure out how 
many row groups it should handle. The SELECT 
statement in callout E does just that. Say that 
(Qend int is 5,000,000. From Figure 1, the function 
should then go up to row group 8, the group that 
includes row 5,000,000 and ends at row 8,388,352. 
Based on the way the math works, which I 
described earlier, using the last number of group 8 
as an example, we start with the equation 


65534 x 2" = 8388352 


and try to get a formula for n, the number of 
row groups. With natural logs and some algebra, 
we get 


n = (In(128))/(InQ)) 


which yields n = 7. In Figure 1, the row group 
numbers start at 1, not 0, so add 1 to n, and you 
get n = 8. A general formula for n would look 
like this: 


n = (In(x/65534))/(In(2)) 


To make the numbers work the way we need, 
round 7 up to the next integer if it’s not an exact 
integer, then add 1. The T-SQL statement at 
callout C does all this; we multiply @end_int by 1.0 
because the math works reliably with real numbers. 
With this expression, for @end_int = 5000000, 
@int_row_groups = 8. The earlier number shift 
is important here. If @start_int is less than 1, the 
natural log function at best would have returned 
the wrong value and at worst would have crashed. 
Although this statement returns 0 for @end_int 
less than 32,768, @end_int will never drop below 
32,768 at this point in the function, so we're safe. 
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LISTING |: Continued 


The function is almost ready to make the row inser- 


tions from integers 32,767 to (gend int. At callout D, "E 
Gend int in the last group. 


it initializes variable (@сштепі row group to 1 and */ 
uses this variable as the loop counter for the WHILE (Еу INSERT INTO GIntegersTable 
loop. Variable (gnum row. groups has the number of SELECT ints + Glast int inserted + (üstep int - 1) 
А FROM @IntegersTable 
row groups the function handles. The WHILE loop WHERE (ints + @last_int_inserted) <= @end_int 
loops once for every row group. Before the loop starts 
= з . я SET @сиггеп row group = Gcurrent row group + 1 
its work, variable (gast int has the last, or highest, 
value already inserted into table variable @Inte- Р 
gersTable. With (glast int inserted, the loop knows 
ж 1 1 1 1 ж 
the integer at which it should start inserting rows. /* Reverse the Integer shift in @IntegersTable, then in Gend int. */ 
Row group 1 is a special case, and @last_int_inserted © IF (@start_int <> 1) 
UPDATE @IntegersTable 

2. о зар | to б SET ints = (ints + (SIGN(@start_int) * ABS(@start_int)) - 1) 

ut the IntegersTableFi already inserted a 

В Ў А oy IF (Gstart int < 1) 

most 32,767 rows. Variable (cast. int inserted equals SET Gend int = (üend int - ABS(üstart int) - 1) 
32,767, so in the loop, the first row group should start /* Trim @IntegersTable, then set up the function return value. */ 
at integer 32,768. Variable (alast int inserted makes DELETE FROM GIntegersTable 
this possible. If the loop is at the last row group, it uses WHERE ints < Gstart int OR 
parameter (фепа int to stop. Otherwise, it just keeps Шш 
going. Setting (депа int this way makes the function INSERT GFinishedIntegersTable SELECT ints FROM QIntegersTable 
more efficient, as I mentioned earlier. For example, if RETURN 
the user picked 16,776,706 for (@епа int, the function Бр 


would end at row group 10. But if the SELECT state- 


ment didn't stop at (gend int, the function would insert Row Group Rows Formis for last 
. row o row 
integers16,776,70 to 33,553,408 and throw them away = 
. . . 1 1 «-» 65534 65534 * (2 ^ 1) 
later. Variable @end_int prevents this waste. 2 65535 «-» 131068 65534 * (2 ^ 2) 
Now the function uses the INSERT INTO state- 3 131069 «-» 262136 65534 * (2 ^ 3) 
ment (callout E) to insert the integers. Earlier, I men- 4 262137 «-» 524272 65534 * (2 ^ 4) 
tioned that the INSERT INTO statement doubles the и 284419 жэ AES ны ee 
à Я 6 1048545 «-» 2097088 65534 * (2 ^ 6) 
number of integers already in @IntegersTable. Look 1 2097089 <-> 4194176 65534 * (2 ^ 7) 
closely at the SELECT statement to see why. As a 8 4194177 «-» 8388352 65534 * (2 ^ 8) 
separate SELECT, it adds (аЛазі int inserted (the 9 8388353 «-» 16776704 65534 * (2 ^ 9) 
latest, largest integer in @IntegersTable) and possibly 19 16116705 ря 33333400 03334 ЗАТЕ ^ 301 
step. int, to every integer already in @IntegersTable. 
@step_ y integ y in @Integ Figure 1 


Then the INSERT INTO statement inserts this new 
row set into @IntegersTable. Thus, for each pass 
of the WHILE loop, the largest integer inserted is 
(@last_int_inserted + (g)last int inserted) plus maybe 
@step_int, doubling the number of integers in @Inte- 
gersTable. Only in the last row group does the last result 
set integer exceed (@епа int. The WHERE clause tests 
for this condition, optimizing the INSERT statement. 
The SELECT statement uses @step_int almost exactly 
the way the IntegersTableFill CTE used it, except that 
here, it subtracts 1 to account for the fact that it oper- 
ates on a "base" set of integers that starts at 1, not 0. 
Finally, the loop increments (current row group. 
When the loop ends, table variable @IntegersTable 
has a “там” list of integers, but input parameter 
@start_int might differ from 1, which is the value the 
function assumed, and the function needs to compen- 
sate. First, if @start_int is less than 1, the UPDATE 
statement (callout F) shifts the integers back to that 
@start_int value. The function recalculates (gend int, 
and the DELETE statement trims @IntegersTable 
accordingly The function inserts everything into 
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@FinishedIntegersTable, which it returns to the T-SQL 
statement that originally called it, and then it ends. 

If @step_int is greater than 1 and @end_int is greater 
than 32,767, the last integer the CTE inserts could have a 
value greater than 32,767 and the largest integers in the 
row groups would exceed the integers in the row groups 
that Figure 1 shows. If CreateIntegersTable handled 
this scenario, it might become even more efficient, but it 
would also become more complex. 


Put ІС to Work 

Web Listing 1 (www.sqlmag.com, InstantDoc ID 
100531) shows how to use CreateIntegersTable. Declare 
a table variable and run an INSERT INTO statement 
with a SELECT statement that calls the function and 
specifies parameters. That’s it. 

Unfortunately, CreateIntegersTable adds entries 
to the tempdb log file, and for a very large integer list, 
this could become a big problem because the log file 
could use a lot of system resources and affect perfor- 
mance. SQL Server 2005 has no way to prevent this 
situation; if it did, the function would have even better 


Calculating row- 
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For information about T-SQL: 

“T-SQL 101, Lesson 1," InstantDoc ID 97724 
“T-SQL 101, Lesson 2," InstantDoc ID 98105 
“T-SQL 101, Lesson 3," InstantDoc ID 98315 
“T-SQL 101, Lesson 4,” InstantDoc ID 98711 
“T-SQL 101, Lesson 5," InstantDoc ID 99137 
“T-SQL 101, Lesson 6," InstantDoc ID 99448 


MICROSOFT RESOURCES 

"How to Create and Use A Numbers Table," 
code.msdn.microsoft.com/SQLExamples/Wiki/ 
View.aspx?title=NumbersTable 


performance and use even fewer resources. I researched 
for a solution but found nothing. If you know how 
to prevent this problem in either SQL Server 2008 or 
2005, please send me an email to tell me about it. 
Function CreateIntegersTable returns a set of rows 
that starts at the value of parameter @start_int—each 
time, every time. However, given specific @start_int, 
@step_int, and @end_int parameters, the final integer 
in the row set that CreateIntegersTable returns might 


differ from the @end_int parameter. This situation 
would happen because of mod function (1.е., division- 
remainder) math and could occur when the @step_int 
parameter is greater than 1. You can use scalar value 
function ActualEndIntegerCalculator, which Web 
Listing 2 shows, to find the actual, largest integer that 
CreateIntegersTable will return given a specific set of 
start, step, and end parameters. This function can go in 
any database, and this example shows how to use it: 


SELECT dbo.ActualEndIntegerCalculator 
(1455, 45, 22401) 


If parameter (gstart int is less than or equal to 0, 
ActualEndIntegerCalculator starts at @start_int and 
finds the multiple of (step int closest to (gend int. If 
(Qstart int is greater than 0, the calculator function 
shifts the @start_int and (Zend int parameters so that 
(start. int is 0, calculates (gend. int based on this shift, 
as before, and then adds back @start_int. If (start int 

is greater than (gend int, the function returns NULL. 
With the CreateIntegersTable and ActualEnd 
IntegerCalculator functions, you have efficient, flexible, 
high-performance tools to build the numbers tables you 
want, when you want. SQL} 
InstantDoc ID 100531. 


... but we've been caught 
ud bragging now and then. 


That's why we're going to let our readers tell you 
why SQL Server Magazine is the top independent 
publication for people who use SQL Server. 


So, direct from our readers’ mouths (yes—really)! 


"| love the CDs. It’s very easy to go back and find a particular topic.’ 


- Debbie Wilkinson, Willis North America Inc. 


"What had been fighting with for three or four days, you guys had 


the solution.’ 


- Dexter Ploss 


А. 
Үү 
"Поме "m уой can go to the website and get a bigger 


icture” 


- JT Vance 


“I real id that article (VMs vs. Multiple SQL Server Instances) 
help Je part about licensing was very important to me. As a DBA 


that does по server or network administration these types of articles 
are really helpful to me^ 


w 


But don't take our word for it! Read our magazine 


or check out our web site today! Keep the discussions B 
going by posting blogs, commentary, videos and more. E RV 


www.sqlmag.com 
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Trace Reporting 
with RML Utilities 


Experience a free and easy way to 
generate reports on your SQL trace files 


у: already know how to parse trace files by 
using home-grown methods that involve SQL 
Servers common language runtime (CLR) func- 
tionality. That methodology remains flexible and 
powerful, but Microsoft has recently updated a set of 
utilities that you can use right away—without needing 
to resort to the CLR. This updated functionality lets 
you perform several SQL Server tasks, but I want to 
focus on the utilities’ trace-reporting aspects. (You'll 
find these utilities—the Reporter and ReadTrace 
executables—in the RML Utilities blog post at blogs. 
.msdn.com/psssql/archive/2007/12/18/rml-utilities- 
for-microsoft-sgl-server-released.aspx.) The utilities 
are well documented and relatively easy to use, so 
my goal this month is simply to make you aware of 
them and show you how they can be a great benefit 
to your arsenal. 


Get Your Act Together 

To use the Reporter utility, you must first use the 
ReadTrace utility to read and parse the SQL trace 
files. However, before you can parse the trace files, you 
need to create them! Refer to my article, "Generating 
Server Side Traces" (see the Learning Path) if you need 
guidance for creating a server-side trace. These utilities 
also require a SQL Server database as a repository 
for the reports. For this purpose, I recommend that 
you create a separate database and use the SIMPLE 
recovery mode. The database's name can be different 
from what the documentation states 1s the default, but 
note that you'll need to specify the name in some later 
commands. The database doesn’t need to be very large, 
but its size will be dependent on the amount and type 
of trace data to process. 


Get Crunching 

After you have the database created and the files ready, 
you can use the ReadTrace utility to read the trace data 
directly from the files. You perform this procedure from 
the command line. (It's very easy to script and auto- 
mate this part of the process.) For example, 


readtrace.exe -IYourPath\YourTrace.trc 


-oYourLogFolder -SYourServer Instance 
-dYourDBName 
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This command will perform some parsing and nor- 
malizing, similar to my previous article's use of the 
CLR method. 

I want to point out a key drawback with the 
utility (at the time I wrote this article): In my testing, 
the parser treated all dynamic SQL (using EXEC or 
sp executesql) the same and wouldn't differentiate 
between two totally different SQL statements. This 
was one reason why I never used these utilities in the 
past and instead created my own CLR-based tools. 
I reported this flaw, along with a few other bugs or 
suggestions, to the PSS SQL Engineers responsible for 
the product. They plan to fix them in a future release. 
Hopefully, the fixes will be available before this article 
sees print. 

Once ReadTrace reads and parses the trace data, 
it places the data into various tables in the database, 
where it's accessible for reporting. If the tables don't 
already exist, the tool will create them for you at this 
time. 


Reporting Gone Wild 
Here's where the Reporter utility comes into play. If 
you started the process by running the ReadTrace 
utility, it will automatically invoke the Reporter GUI 
after populating the tables with the parsed data. How- 
ever, you can also open the Reporter utility at any time 
by simply running reporter.exe. If you aren't using the 
default database name and a default instance, you'll be 
required to make the appropriate changes to point to 
the correct repository. In either case, you'll see a screen 
that looks like Figure 1, page 26. 

This screen provides a summary of what occurred 
within those trace files, broken down by various 
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“Generating Server-Side Traces," InstantDoc ID 99940 
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5 i TRACE REPORTING WITH RML UTILITIES 


1 91 3 du. и resources (e.g., CPU, Reads, Writes). 
: It also shows you the number of 
Performance Overview == у 
Gad Tones TUBE вази batches started and completed. 
ARENA Although you cant see it in the 


figure, this screen also lets you view 
the breakdowns by time based on a 
preset interval. Just expand the View 
Details link to see this data. 
Obviously, if you didn't include 
certain events or columns in your 
trace definition, you won't be able 
to report on them here. However, 
the tools process only those events 
and columns that make sense for the 
intended purpose. Please read the 
documentation to ensure that you 
understand these nuances before 
going too far into your project. 
There are six other types of 
reports that you can access from 
the main report page, but ГЇЇ con- 
centrate on the one titled Unique 
Batch TopN. Figure 2 shows the 
top-most portion of this report, in 
which it breaks down the 10 most 
Figure | resource-consuming query types by 
UsingtheReportertol sss CPU, Duration, Reads, and Writes. 
In this example, I see that 32.2 per- 
cent of my CPU was consumed by 
2 3 uu lev a query that ran 892 times during 
Unique Batch TopN's - this reporting period. Clicking on 
that bar in the graph will bring me 
to the section of the report that lists 
each of the types of queries parsed 
earlier, along with metrics specific to 
each. From there, I can drill down 
even further to see a report specific 
to that query type with even more 
metrics. The report also gives me 
a sample query for that type. Note 
that this is just a random individual 
sample of a real query and might 
not accurately depict all the queries 
for this type in terms of perfor- 
mance or parameters shown. 


Total CPU: 1985416 ms (2.6% Avg Processor Time) 


Give Them a Try 

This has been a brief introduction 
to the ЕМІ, utilities, but I’m sure 
youll agree that they're valuable 
tools for reporting on trace data 
alone. The utilities are simple to use 
and require only a small portion of 
your time to get started. So, what 
Figure 2 are you waiting for? 590 
The Unique Batch TopN example InstantDoc ID 100670. 
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What's NEW for 


Explore the new reporting features 


for SOL Server 2008 


isual Studio 2008 SP1, released in August 
М: finally enables many features that 

didn't make the cut in the Visual Studio 2008 
release to manufacturing (RTM). ГЇЇ show you SPI 
reporting and data caching features that developers 
and architects can leverage in their applications. For 
information about other features in Visual Studio 
2008 SP1, see the sidebar “List of New and Enhanced 
Features in Visual Studio 2008 SP1.” 


SSRS add-in for Visual Studio), you'll immediately 
notice that there is no Data tab in Visual Studio 2008 
SP1 Report Designer. The Data tab has been replaced 
with a new Report Data window, as shown in Figure 
1, page 28. The Report Data window is a peer of the 
Report Item Toolbox, Server Explorer, and the Data 
Sources window. 

The Report Data window also exposes Built-in 
Fields, as you can see in the figure. The Built-in Fields 


William Vaughn 


billva@ betav.com) is an expert on Visual 


node makes it easy to incorporate common system- Tb SQL Serer, pai Services, and data 


generated values, such as Total Pages and User ID, 
into a report. 


What’s New in Reporting? 


Since working with Peter Blackburn on Hitchhiker’s 


access interfaces. He's coauthor of the Hitch- 
hikers Guide series, induding Hitchhikers Guide 


Guide to SQL Server 2000 Reporting Services, Гуе 
acquired a new affinity for reporting technologies. 
I really got hooked when Visual Studio 2005 intro- 
duced the ReportViewer control and gave SQL Server 
Reporting Services (SSRS) developers a refined Report 
Designer and deployment tool. I was disappointed 
to find that Visual Studio 2008 RTM didn’t support 
any of my (or your) existing business intelligence (BI) 
projects, nor could I create new ones. While Visual 
Studio 2008 could open projects that included the 
ReportViewer control, none of my SSRS BI projects 
could be opened. I also discovered that I had difficulty 
creating data sources against the pre-release versions of 
SQL Server 2008. (I recommend that you never install 
pre-release software on a system that you can’t easily 
format and rebuild.) 


The Report Designer 
When I had both SQL Server 2008 and the SP1 version 
of Visual Studio 2008 installed, I was finally able to 
open my Visual Studio 2005 BI projects. I also found 
the cool new SQL Server 2008 Report Designer, which 
re-enabled the projects and associated templates such 
as the Report Server Project Wizard and Report Server 
Project. 

If youre familiar with the Visual Studio 2003 
Report Designer (carried forward from the original 
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to Visual Studio and SQL Server 7th Edition 
(Addison Wesley). 


You also now manage parameters from the Report 
Data window—right-cick the Parameters node to 
add a new parameter (query or report). The action 
launches a dialog box you can use to configure the 


LIST OF NEW AND ENHANCED 
FEATURES IN VISUAL STUDIO 2008 SPI 


In addition to improved support for database development in SQL Server 2008, 
Visual Studio 2008 SP1 provides enhancements for web developers, client 
developers, C# developers, and service developers. Those improvements include 
support for any object relational mapping technologies in ASP.NET Dynamic Data 
and better Windows Presentation Foundation performance. 

Here's the list Microsoft provides of the new and enhanced features in Visual 
Studio 2008 SP1: 


e Smart Device Projects 

* Occasionally Connected Applications 

* Power Packs Controls and Components 
* DataRepeater Control 

* Line and Shape Controls 

ө PrintForm Component 

* Printer Compatibility Library 

* Distributing Power Packs 

e .NET Framework Client Profile Support 


For more information, see msdn.microsoft.com/en-us/library/bb386063 
.aspxitocc connected. 
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VISUAL STUDIO 2008 SP1 


Report Data „ 3 x] parameters name, prompt, data type, 
Nea Edit. X available values, and default values, 
с бә Built-in Fields 21 as well as enable auto refresh when 


=) Execution Time 


=] Report Folder 
ЖЄ] Report Name 
E Report Server URL 


—] the parameter changes. You can also 
manage images through the Report 
Data window. 

More important, the Report Data 
window exposes data sources and 


==] Total Pages data sets used to fetch report or 
E=] User ID .| parameter list data. This window 
=) Language =| also lets you add a new query field 
= irá — or calculated field, manage the query 
оду E = SQL, or set the dataset properties, as 
за 03546292 the context menu in Figure 2 shows. 


ci Adventure Works2008 


Although this is a change from the 


S-E DataSetl Data Set enumeration window in 
E OrderDate the old designer, it's not that dif- 
E] DueDate ferent. This context menu is where 
E ShipDate -| you choose fields and drag them to 
« ees , report elements. 


[:3]Da... | i Se... | z] Ке... ЗА To. 


Figure | 


Visual Studio 2008 
SPI's Report Data 
window 


You can use the new Dataset 
Properties dialog box to configure 
the dataset. This dialog box lets you 
define or edit the query, specify a stored procedure, set 
the query timeout, manage report parameters, manage 
query and calculated fields (including the name and field 
source), set options such as collation, and specify how 
subtotals are managed. To configure how the report 
processor filters inbound rows, you use the Dataset 
Properties Filters window. 

I don't have room here to go into all the details 
of the new server-side SSRS report processor, which 
interprets the Report Definition Language (RDL) 


5 (kj AdventureWorks2008 | report definition created by 
emm | the Report Designer but 
&] Oi Add Query Field... suffice it to say that there 

= 0 Add Calculated Field... have been several signifi- 

E St cant changes. The revisions 

с 9 7 Quey.. include the Tablix controls, 

8 Sa X Delete which combine features and 

7 Dataset Properties functionality of the old Table 

and Matrix controls. There's 

Figure 2 also a new Gauge control and the ability to render 


The dataset context 
menu 
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rich text in the TextBox and other controls. However, 
these changes have been only partially enabled with 
Visual Studio 2008 SP1. These new features are not 
available from the Report Viewer control, but ГІЇ get 
to that a little later. 


RDL and RDLC Files 

The dialog boxes I've described are just a new way to do 
the same tasks you could do by using the Visual Studio 
BI Tools Report Designer in earlier versions. All of these 
settings are persisted in the RDL as XML, so you can (at 
your own risk) edit this file directly when Visual Studio 
gets confused (as I have seen it do on a few occasions). 


The new SQL Server 2008 Reporting Services 
server-side report processor interprets what I call 
second-generation RDL files as generated by the 
Visual Studio 2008 SP1 BI tools. But here's the rub: 
Visual Studio 2008 projects still create first-generation 
client report definition files (RDLCs), even with SP1. 
What this means is that you'll be able to import first- 
generation RDL reports into the Visual Studio 2008 
SP1 Report Designer, but you worr't be able to use them 
with the “new” Visual Studio 2008 MicrosoftReport- 
Viewer control or in any older versions. The “real” 
MicrosoftReportViewer control is not expected until 
the next Visual Studio release—in 2010. 


Visual Studio 2008 SPI 
and SQL Server 2008 
SQL Server 2008 brings a lot of useful functionality 
to your toolbox. Visual Studio 2008 SP1 (finally) adds 
the ability to manage SQL Server 2008 databases from 
Server Explorer. This enhancement includes the ability 
to create SQL Server 2008 server-side executables. With 
Visual Studio 2008 SP1, you'll be able to use Server 
Explorer to 
* access SQL Server 2008 and create data connec- 
tions against SQL Server 2008 instance databases or 
create new SQL Server 2008 databases. 
* manipulate SQL Server 2008 executables. To do so, 
start a Visual Basic, C£, or C++ database project, 
or simply navigate to and then manage stored pro- 
cedures as you could in Visual Studio 2005. You'll 
also discover that SQL Server Management Studio 
(SSMS) has incorporated the ability to step through 
stored procedures in SQL Server 2008. 
create tables that leverage the new SQL Server 
2008 data types, including GEOMETRY, GEOG- 
RAPHY, HIERARCHYID, DATE, TIME, DATE- 
TIMEOFFSET, апа РАТЕТІМЕ?, although 
not the new FILESTREAM designation on 
Varbinary(max) columns. 
leverage the new ADO.NET 3.5 Synchronization 
Services and Visual Studio Local Data Cache tech- 
nology in a whole new way. 
create SQL Server Compact 3.5 databases. I call this 
database engine “SQL Compact" to keep folks from 
confusing it with other SQL Server versions that 
share common binaries. 
permit developers to use ADO.NET 3.5 to pass 
tables as ad hoc or stored-procedure parameters. 
This solves a couple of long-standing issues and 
opens up several new data management para- 
digms. For example, you can pass a set of rows in 
a structured DataTable to be merged into a data- 
base without having to send individual SQL Data 
Manipulation Language queries. You can also pass 
a table of acceptable values directly to a WHERE 
clause IN expression, as shown in Listing 1. 
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Data Caching 
Visual Studio 2008 SP1 refines the ability to 
create and manage replicated data sources 
with the Local Data Cache classes it gen- 
erates Up to now, replication scenarios 
have been the purview of DBAs. Now that 
virtually any Visual Studio data source can 
be synchronized with its data source, devel- 
opers don't have to worry about 

* SOL-based updates against local data. 
Changes can be saved to the data row 
Value property, and the row(s) can be 
synchronized against a common 
database. 

* synchronizing lookup tables with 
common database data values. 

* keeping UI metadata in sync in deployed 
applications. The metadata values can 
also be synchronized against a common 
database. 

* working with disconnected data sources 
for fear that the local data is not secure. 
The SQL Compact database used to host 
client-side data can be encrypted or pro- 
tected by using an ACL. 


The SQL Server 2008 impact on the server-side 
database is virtually invisible. If you try to enable local 
database caching in the Data Source Configuration 
Wizard (as shown in Figure 3) with a pre-SQL Server 
2008 system and you select the Incremental synchro- 
nization mode (see Figure 4), you must make the fol- 
lowing changes to the database tables: 

* Add LastEditDate and CreationDate columns to 
the tables. 

* Add a tombstone table named basetablename_ 
Tombstone. Make sure the table contains the primary 
key and DeletionDate columns that are required in a 
tombstone table. 

* Add an update trigger, an insert trigger, and a 
deletion trigger, named basetablename_Update- 
Trigger, basetablename Insert Trigger, and basetable- 
name_DeletionTrigger, respectively, to manage the 
tombstone table. 


You can add a script to generate these base table 
changes to your project. 

The wizard also creates an undo script to back out 
these changes. Both scripts are saved to your project 
upon demand. If you don't have the necessary rights 
to execute the script, you can choose not to execute it. 

If you’ve installed SQL Server 2008, you can check 
Use SQL Server Change Tracking in the Wizard, as 
shown in Figure 4. This option also creates a script, 
but it’s a bit simpler, as Listing 2 shows. 
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LISTING 1: Passing a Table-Valued Parameter 
to an IN Expression 


cmd = New SqlCommand("SELECT Publishers.City, Publishers.State, Publishers.PubName " _ 
& " FROM Publishers WHERE State IN (SELECT State FROM @StateList)", cn) 


'Define table-valued parameter along with server-side user data type typename 
cmd.Parameters.Add("@StateList", SqlDbType.Structured).TypeName = "dbo.Statelist" 


У Enable local database caching 
DataSet name 


erData5et 


What Pm Still Waiting For 
You can't use Visual Studio 2008 5РІ to view, create, 
or set properties for log-in accounts or set rights on 
any object in the database. You'll have to use SSMS for 
these essential tasks. Also, Visual Studio can't create a 
new table that has а FILESTREAM designation. I'd 
like to see these enhancements soon. [SOL 
InstantDoc ID 101173 


Figure 3 


Enabling local database 
caching against a data 
source 


Data Source Configuration Wizard 
[ 
4 Choose Tables to Cache 
Which tables do you wert to cache? 
Table Name Synchremaation Mode 

4| Valid states Incremental т” 
7 ZipCode: 
7 Use SQL Server change tracking 
Synchronization settings filename 

D. < Previous ШЕШ” | Cancel | 

Figure 4 


LISTING 2: Excerpt of Script 
Created with Data Source 
Configuration Wizard's Use SQL 
Server Change Tracking Option 


IF NOT EXISTS (SELECT * FROM .. 
ALTER TABLE [dbo].[ValidStates] 
ENABLE CHANGE TRACKING 

GO 


Configuring the caching 
operations 
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SQL Data Generator 
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've been using Red Gate Softwares SQL Data 

Generator 1.2 for a while now and have really 
grown to love it. I’ve used it to create sample data for 
development and testing and to quickly populate tables 
to validate performance requirements and address 
capacity planning needs. I’ve also used it to generate a 
whole suite of intricately related data (nearly 1GB) for 
a sample data warehouse. In all these cases, the tool 
performed admirably. 

The first time I used SQL Data Generator, I needed 
to get it up and running quickly. Happily, installation 
was a breeze and within a few minutes it generated my 
data. The intuitive UI uses the concept of “projects”: 
With each project, you point SQL Data Generator at 


a target database, let it read the schema, then specify 
how many rows you want loaded into each table. You 
can also save projects to reuse your specifications and 
customizations for each data-load operation. 

The tool really shines when you're specifying the 
kinds of data that you want to generate for each of your 
tables. It offers a wide assortment of “generators” that 
you can select from and assign to each column. 

Simple generators generate sequential or random 
INTs and UNIQUEIDENTIFIERs, and weighted-list 
generators let you manually create lists of data and 
weight the frequency at which each item should appear 
within the generated results. 

You can also use Foreign Key Generators to pull 
in data from a reference table, and SQL Statement 
Generators, which let you provide a connection and 


SQL DATA GENERATOR 


Pros: Enables quick and easy generation of sample 
data for SQL Server 2008, 2005, and 2000; 
addresses real-world data-generation needs 


a custom query for generation purposes. A handful 
of business, personal, and other types of canned data 
generators make it very easy to generate commonly 
occurring types of data. And if these data generators 
don’t meet your needs, you can import data from 
comma-separated value (CSV) files or create custom 
generators. 

One of my favorite generators is the RegExpGen- 
erator, which lets you specify a regular expression that 
the tool basically turns into “regex in reverse” for popu- 
lation purposes. Besides letting you combine data and 
contents from flat files, it also provides a very powerful 
way to generate sample and test data that represent a 
wide variety of cardinalities for performance testing. 

Best of all, with each generator-to-column map- 
ping, you can specify whether values should be unique, 
as well as what percentage of values should be NULL 
(assuming NULLs are allowed) and even set the seed 
used for randomization. And, as you can see from 
Figure 1, all of this can be managed from within a very 
easy-to-use UI. 

SQL Data Generator provides the option to bind 
your own scripts for execution before and after data 
generation. This option can help in preparing an 
environment for rapid loading, and I’ve found it very 
useful in ensuring that my parent-child relationships 
are temporally viable. 

Given how easy SQL Data Generator is to use and 
extend, how well it performs, and how quickly it pays 
for itself by providing real value at a cheap price, I 
honestly don’t think that any developer or DBA should 
be without it. It’s a great tool with lots of real-world 
potential. SQL] 

InstantDoc ID 100517: 


Cons: Тһе only conceivable improvement would be if it some- 
how let you run its logic against existing data (in the form of 
UPDATEs instead of INSERTs) 


Rating: ЖСЖ 


Price: Starts at $295 per license, volume discounts available 


Recommendation: SQL Data Generator is ideal for creating 
sample and test data for quality assurance, development, per- 
formance tuning, and capacity planning. 


Contact: Red Gate Software • www.red-gate.com 
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Miner3D 7.1 


Ost businesses struggle to make insights from 

multidimensional analysis available to end 
users. Pivot tables created by spreadsheet programs 
can help users get business insights by enabling data- 
led discovery, but pivot tables too often require users 
to pore over spreadsheets full of data to spot potential 
problems, trends, or areas in need of investigation. 
Making multidimensional data easier to use is where 
Miner3D comes into play. 

Within an hour of installing Miner3D 7.1, I was 
impressed. Installation was a breeze. The application 
can use data from SQL Server as well as Microsoft 
Access by default; you can also configure it to use data 
from Oracle, IBM DB2, and MySQL databases. The 
program generates 3D charts and graphics that are 
live—meaning you can modify them in real time. 

Miner3D is surprisingly intuitive to use, partly 
because of the UI’s intelligent use of a Microsoft Office 
2007-style ribbon. The ribbon groups relate operations 
and options in ways that make it easy to find exactly 
what you're looking for. It would be nice if there were 
a few additional options for placing and formatting 
the legend for charts and graphs, but this is more of a 
nitpick than an actual problem. 

Miner3D’s UI shows impressive forethought, and 
the entire interface is capable and mature. If you can 
create a pivot table in Microsoft Excel using OLAP 
data, you'll have no problem learning to use the appli- 
cation to create not only reports and graphs, but also 
powerful graphics. 

Especially exciting is how well Miner3D handles as 
you navigate your business data. Creating reports and 
visual representations of your data almost feels like 
playing a video game rather than working with a busi- 
ness tool. I was really impressed by the size of the cubes 
I was able to throw at Miner 3D while still enjoying 
snappy response time and performance. Miner3D shows 
its true value and usefulness in its ability to create pow- 
erful visualizations that let users derive business insights 
in a way that I haven't seen elsewhere 

What I love most about Miner3D is that it bridges 
the gap between data-led discovery and the use of 
Key Performance Indicators by letting end users easily 
throw together visualizations that can give powerful 
business insights. For example, Figure 1 shows how I 
was easily able to visualize order quantities on a scatter 
plot, with box sizes representing quantities. 

With Miner3D, end users can painlessly change 
graphing options, brush colors and types, and linkages 
between related data in near real time. They can, with 
very little effort, fast-track the task of deriving business 
insights from massive amounts of data. 
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Where the product really shines is in how it lets 
users apply dynamic filters. Users can simply drag 
sliders or painlessly set filtering criteria, and Miner3D 
applies the changes in real time. This feature, when 
added to Miner3D’s other functions, lets users slice and 
dice data along contextually relevant relationships that 
make the decomposition and aggregation of business 
data a breeze. 

If youre looking for a product that lets users 
quickly and easily analyze business data, Miner3D is 
definitely a solution that you should evaluate. For a BI 
solution, it's relatively inexpensive to license, and its 
ease of use, versatility, and useful visualizations allow 
it to pay for itself in short order. SQL] 
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Visualizing order quantities 


MINER3D 7.1 


Pros: Fast, robust rendering engine; mature, well designed, intuitive 
interface; visualizations of large amounts of data don’t degrade performance 


Cons: Could use more options for placing and formatting legends for charts 
and graphs 


Rating: АССА 


Price: Ranges from $495 for the Basic version (without OLAP connectivity) 
to $2,490 for the Enterprise version (with five seats), including one year of 
support and maintenance. 


Recommendation: Miner3D is useful for users who need to quickly, thor- 
oughly, and efficiently parse large amounts of data to spot trends, problems, or 
areas of the business that need additional attention. 


Contact: Miner3D е 302-213-0121 е www.miner3d.com 
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SQL Server Freebies at 
Microsofts CodePlex Site 


Michael Otey 


motey (0) sqimag.com) is technical director 
for Windows IT Pro and SQL Server Magazine 


and author of Microsoft SQL Server 2008 New 
Features (Osborne/McGraw-Hill). 


his seems to be the era of taking things away. 

First, companies changed their packaging so 
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money. Then (and probably the most upsetting), Co 
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Й shouldn't be surprised. At least Microsoft had the | 
good sense to give you a little something extra “ау 


Е ven before SQL Server 2005, Microsoft was gradu- 
ally pulling sample databases that it used to include 
with SQL Server and posting them to its CodePlex 


open-source project website instead, at www.codeplex 


.com. The site is loaded with interesting and useful 
SQL Server samples as well as tools and utilities. I 
found seven especially interesting downloads. 


AdventureWorks and 
AdventureWorksDW 

For SQL Server users, the first stop at CodePlex is 
almost always for the sample databases. Adventure- 
Works and AdventureWorksDW for SQL Server 2005 
and SQL Server 2008 are both here in 32-bit and 64-bit 
versions. You can download the sample databases 


from www.codeplex.com/MSFTDBProdSamples. 


AdventureWorks StoreFront 

The AdventureWorks database back end is only 
half of the application-development picture. To get 
the full end-to-end view, you need the application 
front end as well: Download the AdventureWorks 


StoreFront web application from www.codeplex.com/ 
MSFTEEProdSamples. 


Large Object Handling 

Dealing with large object (LOB) data is always a source of 
confusion, partly because Microsoft keeps changing the 
way you handle LOB data. For some examples of how 
to use the varbinary(max) data type from CLR stored 


procedures, see www.codeplex.com/MSFTEngProd 
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MDX Script Performance 
Analyser 

The MDX Script Performance Analyser lets you see 
how the different components of an MDX query con- 
tribute to its overall performance. To use the tool, simply 
connect to the database and enter the MDX query, and 
the tool will graph query performance. You can down- 


load the tool from www.codeplex.com/mdxscriptperf. 


Open DBDiff 

Open DBDiff is a SQL Server database differencing 
utility. This tool compares two SQL Server 2005 data- 
bases and generates a T-SQL script that can synchro- 
nize the databases in either direction. Open DBDiff 
also synchronizes tables, columns, indexes, XML 
indexes, user data types, triggers, functions, stored pro- 
cedures, and more. You can download Open DBDiff 


from www.codeplex.com/OpenDBiff. 


SQL Data Services Examples 

If you're afraid of being left behind in the rush to 
cloud computing, jump in and download the SQL 
Data Services (SDS) examples, which illustrate 
how to develop applications for Microsoft's cloud-based 
SDS. (For information about SDS, see msdn.microsoft 
.com/en-us/sqlserver/dataservices/default.aspx.) You can 
download the sample application source code from 


www.codeplex.com/ssdsexamples. SQL} 
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SOLSENTRY 


PerformanceAdvisor ° 


The New Standard in Monitoring and Performance 


Displays the most important Windows and SQL Server performance metrics 
side-by-side in a single view, so you have the full picture at a glance. 


Easily switch between real-time and historical modes to view performance metrics 
for any point in time. Go back days or even months to review performance trends. 


Wait Type analysis shows both high-level and detailed resource utilization, giving 
you an instant performance profile for the SQL Server. 


Quick Trace™ provides a snapshot of exactly which processes and applications are 
consuming the most SQL Server resources. 


The Process Activity viewer shows Windows process-level CPU, paging, and other 
МО metrics on a server with a single-click. 


Disk latency charts show you exactly how long reads and writes are taking for each 
disk and each database file, quickly highlighting disk bottlenecks. 
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Sample View: 
SQL Server Waits 


Performance Dashboard with relevant SOL Server • Top SQL analysis highlights heaviest queries 


and Windows metrics 


Real-time and historical performance analysis 


* Graphical blocking and deadlock analysis 
Calendar views of Top SQL, blocks and deadlocks 


Disk activity, latency, and capacity monitoring “ One-click and automated tracing with Quick Trace™ 


Free Trial Download: sqlsentry.net/sql-performance 
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Let SQL diagnostic manager read your SQL Server's mind! 
Foresee and solve real problems before they really happen. 


Don't you wish you knew when bad things we're going to happen to your SOL Servers... 
before they actually happen? With SOL diagnostic manager, you gain psychic abilities to 


foretell performance issues even before your users report them! 


SQL diagnostic manager: 


Foretell SQL Server problems. 


Forecast outages and performance blocks. 


Get contol. 


www.idera.com/psychic 


idera’ 


MANAGING YOUR WINDOWS WORLD ™ 


TRY IT NOW! 
DOWNLOAD FOR FREE: 

al un 
ipERA.cow/esvcuc 2: 


With over 100,000 SQL Servers monitored worldwide, Idera leads the market in SQL Server performance and diagnostics solutions. 


Our products are easy to use and low-impact. What's more, you'll be up and running in minutes! 


